NLP 学习笔记 / NLP001

NLP:从语言特点到研究应用

自然语言处理(NLP)用计算方法处理人类语言,通过人工规则或从数据中学习模式,完成分析、信息提取、预测和生成等任务。

大语言模型是其中一类技术。 [1]

一图梳理

知识图解
NLP 信息图:语言特点、模型、常见任务、语音分析及访谈应用
NLP:从语言特点到研究应用

01语言里的信息

观察层面关注的问题例子
词的构造与词义词怎样组成,表达什么意义?happy → unhappy;“满意”与“不满意”
句子结构与句意谁做什么,评价指向谁,是否存在转折?“解释很清楚,但等得太久”:肯定解释,不满等待
前后文与表达意图指代谁?为什么在这个情境下这样说?“说明有点难懂”可能是在请求进一步解释

这些是理解语言的视角,不是每个模型都必须依次执行的步骤。 [1][2]

语言构造、句法、语义与语境的概念示意图
语言结构与语境

语言分析的示意图,并非模型内部的固定层级。NLU 与 NLG 不必遵循严格相反的处理路线;语境也不局限于某一层。

02语音分析:除了说什么,还看怎么说

线索关注内容
音量声音的大小及变化
语速说话的快慢及变化
表达方式语调、重音、停顿等

这些声学与韵律线索需要结合话语内容和情境理解。普通转写文本通常不能完整保留它们;分析时需要音频或相应声学特征。语音分析与文本分析可以结合使用,但测量声音特征并不等同于理解语言内容。 [3]

03常见任务

任务解决什么问题
情感分析对什么持正面、负面或混合评价?
情绪线索识别表达中有哪些直接或间接的情绪线索?线索不等于临床诊断
信息提取找出研究需要的主题、实体或事件,组织为字段/标签并关联原文
总结类任务(summarization)归纳要点,形成访谈总结、会议总结或材料概览,保留重要转折与不确定性
翻译与问答跨语言表达信息,或针对材料回答问题

同一段话,可以服务不同任务。

“解释很清楚,但等得太久。”

情感分析

解释:肯定;等待:不满

信息提取

解释质量、等待体验

总结

同时保留这两方面

总结类任务关注内容要点,语音分析关注声音及表达线索,两者可以在同一工作流中使用。

04我的思考与应用

我的理解

从词、句子到语境,NLP 的入口是语言本身;把语言特点和具体任务联系起来,框架就更容易理解。

我的应用方向

我过去通过手动标记和关键词提取处理访谈。接下来想尝试用 NLP 辅助整理,并归纳受访者表达的主要观点。

  1. 研究问题
  2. 所需信息
  3. 字段/标签
  4. 回到原文核对

是否有效,需要看遗漏、标签质量,以及纠错后真正节省的时间。

05手写笔记

一页关于语言特点、常见任务与语音表达的学习记录。

中英文手写 NLP 笔记,记录模型、语言特点、情感分析、语音与文本任务
NLP 入门手写笔记

06参考资料

  1. Jurafsky & Martin — Speech and Language Processing
  2. Words and Tokens
  3. audEERING — Prosody & speech features
延伸阅读Tang 等(2023)关于医学证据总结的评估 ↗

研究对象与模型版本有特定范围,不代表访谈整理流程已经验证。

NLP Learning Notes / NLP001

NLP: from language to research applications

Natural language processing (NLP) uses computational methods to work with human language. Systems use explicit rules or learn patterns from data to analyze, extract, predict, and generate information.

Large language models are one family of technologies within this field. [1]

The big picture

Visual notes
NLP study diagram covering language features, models, common tasks, speech analysis, and interview applications
NLP: from language to research applications

01Information in language

PerspectiveWhat to look forExample
Word structure and meaningHow words are formed and what they meanhappy → unhappy; “satisfied” versus “not satisfied”
Sentence structure and meaningRoles, evaluation targets, and contrasts“The explanation was clear, but the wait was too long” evaluates two things differently
Context and intentReferences across sentences and the purpose of an utterance“These instructions are confusing” may be a request for clarification

These perspectives help explain language; they are not mandatory sequential stages in every model. [1][2]

Conceptual illustration of morphology, syntax, semantics, and pragmatics
Language structure and context

A conceptual illustration, not a fixed architecture inside a model. NLU and NLG need not follow strictly inverse pipelines, and context matters across perspectives.

02Speech analysis: how something is said

CueWhat it captures
LoudnessHow loud or soft the voice is, and how it changes
Speaking rateHow quickly or slowly someone speaks
DeliveryIntonation, stress, pauses, and related patterns

Interpret acoustic and prosodic cues alongside the words and the situation. A plain transcript usually does not preserve all of them; analysis needs audio or the relevant acoustic features. Speech and text analysis can be combined, but measuring vocal features is different from interpreting linguistic content. [3]

03Common tasks

TaskThe question it addresses
Sentiment analysisWhat is being evaluated positively, negatively, or in mixed terms?
Emotion cue recognitionWhat feelings are expressed or implied? A cue is not a clinical diagnosis
Information extractionWhich themes, entities, or events should become fields or labels linked to the source?
SummarizationWhat are the main points of an interview, meeting, or body of material? Preserve important contrasts and uncertainty
Translation and question answeringHow can information be expressed in another language, or used to answer a question?

One passage can support several tasks.

“The explanation was clear, but the wait was too long.”

Sentiment analysis

Praise for the explanation; frustration with the wait

Information extraction

Explanation quality and waiting experience

Summarization

Preserve both judgments

Summarization concerns the key content, while speech analysis examines vocal cues. A workflow can use both.

04My perspective & use case

My starting point

Language itself makes NLP more approachable. Connecting words, sentences, and context to specific tasks helps me understand the broader framework.

My research direction

I have worked with interviews by manually marking passages and extracting keywords. I want to explore NLP-assisted organization and summaries of participants’ main points.

  1. Research question
  2. Information needed
  3. Fields or labels
  4. Source check

Usefulness depends on omissions, label quality, and time saved after corrections.

05Handwritten notes

A working note on language features, common tasks, and vocal expression.

Original bilingual handwritten NLP notes on models, language, sentiment, speech, and text tasks
Handwritten notes on NLP

06References

  1. Jurafsky & Martin — Speech and Language Processing
  2. Words and Tokens
  3. audEERING — Prosody & speech features
Further readingTang et al. (2023), evaluating medical evidence summarization ↗

Its findings concern particular models and a specific task; they do not validate an interview-analysis workflow.

原图 / Original ↗