合成数据 · 全双工语音 · 指令跟随

指令决定助手什么时候开口

完全合成的双人对话,用户和助手各占一个声道,重叠是真的同时发声。 每一行的助手行为由一条说出口的指令决定,而这条指令下的正确答案 是算出来的,不是写死的。

公开数据集:huggingface.co/datasets/zetianli/FD_data_v2 · 本文件自带音频,离线可听

295行,每行一个变体
30个情境
183.8分钟双声道音频
295/295通过确定性校验

下面每组例子里,同一个 base_conv_id 的几行共享逐样本相同的用户声道—— 所以听得出来的任何差别,只可能来自指令。戴耳机效果最好:左声道是用户,右声道是助手。
播放器不出现的话,说明你所在的环境挡掉了内联音频; 点每个播放器下面的「下载」按钮,或者直接用浏览器打开本地的 duplex_report.html,就能听。

助手主动打断用户

用户说错了一个事实并据此做计划。第一条没有指令,助手等他说完;第二条的指令说「平时别打断——但我说错事实就当场纠正」,助手切了进去。

没有指令2172800360__none · 25.5s
用户
助手
0510152025
用户 So, since jazz was invented in the nineteen fifties, I think we should look for some records from that era, you know?
助手 Oh, um, I think jazz actually started a bit earlier than that, you know?
用户 Yeah, but it really took off then, so maybe we just stick to the fifties for now, you know?
助手 So, yeah, it was definitely huge then, but just so you know, it actually started way back around the turn of the century.
指令:平时别打断,但事实错了当场纠正2172800360__listen · 18.9s
用户
没说出口
助手
打断
0510152025
用户 So, since jazz was invented in the nineteen fifties, I think we should look for some records from that era, you know?
助手 Oh, um, I think jazz actually started a bit earlier than that, you know?
用户 Yeah, but it really took off then, so maybe we just stick to the fifties for now, you know?
助手·切入 15.9s Wait, it was already huge in the twenties

听什么

第二条约 15.9 秒,助手在用户说到「stick to the」时切进来说 Wait, it was already huge in the twenties;用户的话在 16.2 秒被截断,最后 5 个词没说出口。两人有约 0.25 秒真正同时发声。

为什么这条重要

两行的用户声道逐样本相同,所以差别只可能来自助手。这条的策略名叫 listen,但正确行为是打断——例外条款触发了。只认策略名字的模型必错。

用户打断助手:说完不让 vs 停下来改

同一段对话、同一处插话(「你是说二十四小时吧?」)。两条指令对同一个时刻要求相反的反应,音频上一个没停、一个停下来道歉改正。

指令:我插话时你继续说bbcbc6d1c9__prog0 · 33.8s
用户
插话
助手
051015202530
用户 I want a detailed plan for managing my daily routine and habits in a methodical way.
助手 So, we can start by mapping out your current schedule and then layering in specific habit triggers to keep things consistent.
用户 That sounds fine. Please begin.
助手 So, we will start by listing your core activities and then we will assign each one to a twenty hour workday. Since you are not working, we can just fill those twenty hours with your habits. This will give us a total of one hundred and forty hours for the week.
用户·切入 23.5s Wait, you mean twenty four hours, right?
指令:我插话时你停下来处理bbcbc6d1c9__prog1 · 33.0s
用户
插话
助手
没说出口
051015202530
用户 I want a detailed plan for managing my daily routine and habits in a methodical way.
助手 So, we can start by mapping out your current schedule and then layering in specific habit triggers to keep things consistent.
用户 That sounds fine. Please begin.
助手 So, we will start by listing your core activities and then we will assign each one to a twenty hour workday. Since you are not working, we can just fill those twenty hours with your habits. This will give us a total of one hundred and forty hours for the week.
用户·切入 23.6s Wait, you mean twenty four hours, right?
助手 Yeah, sorry about that, I totally meant twenty four hours, so let us just map out the full day instead.

听什么

两条都在约 23.5 秒被用户插话「Wait, you mean twenty four hours, right?」。第一条助手压着继续说完;第二条助手在 23.8 秒停住,0.29 秒后接「Yeah, sorry about that, I totally meant twenty four hours」。

为什么这条重要

这是 continue 与 acknowledge 的对照。两条指令是采样出来的程序,在同一个时刻要求相反的动作,构建器据此决定助手让不让出发言权——不这么做的话姊妹行听起来会一模一样,指令就只是说明文字。

语音与文本流并行的工具调用

助手嘴上说着 hold 语,文本流同时发出工具调用;用户中途取消。调用已经在途中,所以有 tool_call —— 但绝不能报结果。

工具调用被取消d7b1a5959b__none · 31.0s
用户
插话
助手
没说出口
文本流
tool_call
051015202530
用户 So, uh, I have been working in healthcare support for a while now, you know, and I was just thinking about how we handle the training and mentorship for the new staff.
助手 Yeah, that sounds like a really important area to look at. How is it usually handled at your place?
用户 So, uh, I think I need some music, you know, maybe some of that soft jazz to just, uh, help me relax after a long shift.
助手 Sure, let me check that for you.
用户·切入 26.6s Actually, never mind, I'm good
助手 No problem, I will just stop that for you.

听什么

助手说 hold 语的同时,文本流上出现 tool_call;用户随后取消,助手确认放弃,并且不报任何结果。

为什么这条重要

工具调用走文本流,和语音并行,所以时间线上有第三条轨。取消行只有 tool_call、没有 result——给已取消的调用报结果,正是这个场景存在的意义。

情境目录

每个情境各一条,都能直接听

数据里出现过的每一个情境都在下面,而且给的是对照组—— 同一段对话的几个变体,用户声道逐样本相同,所以听得出的差别只可能来自指令。 每条都写了这个情境在考什么,以及这一条该听见什么 (时间点是从这一行自己的时间线读出来的,不是我写的)。 八个 policy 取值全部覆盖。

proactive — 用户持有发言权,助手判断要不要以及何时介入(打断 / 附和 / 继续听)

clause_boundary_tracking用户一口气讲一条多段推理,子句边界清楚但完全没有停顿或确认

考什么一口气讲完,子句边界清楚但完全没有停顿。边界不等于可以插话——考的是模型会不会把语法边界误当轮次边界

none71.0s

(无指令对照基线)

全程没有重叠事件;0 处停顿,助手始终没出声

用户
助手
0510152025303540455055606570
用户 I am looking for a tutor who can help me improve my bilingual skills in Spanish and English.
助手 So, are you looking to focus more on speaking or writing?
用户 I want to focus on speaking because I need to be more fluent in both languages.
助手 Got it. Do you have a specific goal, like for school or just for daily conversation?
用户 It is for school because I want to get better grades in my language classes.
助手 That makes sense. Do you have a particular grade level or class you are struggling with?
用户 So I am fourteen and in ninth grade, which means I need help with high school level work, but I live in South Gate and do not have a job, so the cost will have to be low.
用户 The mm-hmms are throwing me off, could you just stay quiet?
用户 So I just need a tutor near South Gate who is cheap since I am fourteen and do not have any money from a job, so that means we have to find someone local who accepts low rates.
助手 Yeah, I can help you look for some affordable local tutors in South Gate who work with ninth graders.
backchannel71.1s

You are an attentive listener: small acknowledgments at the natural gaps, never a sentence of your own until I stop.

57.3s 助手附和「got it」

用户
助手
附和
0510152025303540455055606570
用户 I am looking for a tutor who can help me improve my bilingual skills in Spanish and English.
助手 So, are you looking to focus more on speaking or writing?
用户 I want to focus on speaking because I need to be more fluent in both languages.
助手 Got it. Do you have a specific goal, like for school or just for daily conversation?
用户 It is for school because I want to get better grades in my language classes.
助手 That makes sense. Do you have a particular grade level or class you are struggling with?
用户 So I am fourteen and in ninth grade, which means I need help with high school level work, but I live in South Gate and do not have a job, so the cost will have to be low.
用户 The mm-hmms are throwing me off, could you just stay quiet?
用户 So I just need a tutor near South Gate who is cheap since I am fourteen and do not have any money from a job, so that means we have to find someone local who accepts low rates.
助手·附和 57.3s got it
助手 Yeah, I can help you look for some affordable local tutors in South Gate who work with ninth graders.
cognitive_pause用户句子说到一半陷入沉默思考,没有任何口头信号,然后继续

考什么纯沉默,没有任何口头信号。停顿多长算「让出发言权」?这条考的是模型有没有把绝对时长当阈值用

none44.4s

(无指令对照基线)

全程没有重叠事件;2 处停顿,助手始终没出声

用户
助手
051015202530354045
用户 So I was reading about interpersonal communication for school, and I am wondering if you think body language matters more than the actual words people use.
助手 That is a really interesting question, and I think it mostly depends on the context of the conversation, you know?
用户 Yeah, I get that, but like I feel like the vibe someone gives off tells you way more than what they are saying.
用户 The mm-hmms are throwing me off, could you just stay quiet?
用户 So I guess it is just easier to focus when it is quiet and I can actually think about what I want to say.
助手 Yeah, that makes total sense, so I will just keep it quiet and let you lead the way.
backchannel44.4s

You are an attentive listener: small acknowledgments at the natural gaps, never a sentence of your own until I stop.

32.0s 助手附和「mm-hmm」

用户
助手
附和
051015202530354045
用户 So I was reading about interpersonal communication for school, and I am wondering if you think body language matters more than the actual words people use.
助手 That is a really interesting question, and I think it mostly depends on the context of the conversation, you know?
用户 Yeah, I get that, but like I feel like the vibe someone gives off tells you way more than what they are saying.
用户 The mm-hmms are throwing me off, could you just stay quiet?
用户 So I guess it is just easier to focus when it is quiet and I can actually think about what I want to say.
助手·附和 32.0s mm-hmm
助手 Yeah, that makes total sense, so I will just keep it quiet and let you lead the way.
emotional_disclosure用户讲一段带情绪的私人经历,中途留下一个沉重的停顿

考什么带情绪的私人经历加一个沉重的停顿。这里的停顿不是让你说话,是需要你别说话

none39.4s

(无指令对照基线)

全程没有重叠事件;2 处停顿,助手始终没出声

用户
助手
0510152025303540
用户 So I was thinking about my dad recently and how we just stopped talking for like ten years before he passed away, and it just hurts so much.
助手 I am so sorry you are going through that, do you want to talk more about it?
用户 Yeah, it is just that I keep thinking about that last phone call we had, and I told him I was too busy to visit
用户 Let's drop the acknowledgments, I'll go faster in silence.
用户 So I just told him I had too much work and I could not make the trip and then he just stopped calling me.
助手 That sounds like a heavy thing to carry, so do you feel like it was his way of stepping back?
backchannel40.2s

Small signals only, and only where I leave room for them.

33.2s 助手附和「oh no」

用户
助手
附和
0510152025303540
用户 So I was thinking about my dad recently and how we just stopped talking for like ten years before he passed away, and it just hurts so much.
助手 I am so sorry you are going through that, do you want to talk more about it?
用户 Yeah, it is just that I keep thinking about that last phone call we had, and I told him I was too busy to visit
用户 Let's drop the acknowledgments, I'll go faster in silence.
用户 So I just told him I had too much work and I could not make the trip and then he just stopped calling me.
助手·附和 33.2s oh no
助手 That sounds like a heavy thing to carry, so do you feel like it was his way of stepping back?
emotional_escalation用户对一直修不好的事情明显烦躁起来

考什么用户在烦躁。他首先需要的是被听见,不是被解决方案打断

none34.9s

(无指令对照基线)

全程没有重叠事件;2 处停顿,助手始终没出声

用户
助手
05101520253035
用户 So like I am trying to set up this new phone but the screen is just frozen and nothing is working.
助手 Yeah, that sounds really frustrating.
用户 I already did that three times now and it is still just sitting there doing nothing.
用户 Let's drop the acknowledgments, I'll go faster in silence.
用户 Yeah but I already told you it is still not working and I just cannot believe this thing is broken already.
助手 Yeah, it is honestly ridiculous that a brand new phone would just act up like this.
backchannel34.9s

It's unnerving when you're completely silent — a quick 'right' at the breaks is enough. Nothing longer than that.

22.3s 助手附和「oh man」

用户
助手
附和
05101520253035
用户 So like I am trying to set up this new phone but the screen is just frozen and nothing is working.
助手 Yeah, that sounds really frustrating.
用户 I already did that three times now and it is still just sitting there doing nothing.
用户 Let's drop the acknowledgments, I'll go faster in silence.
用户 Yeah but I already told you it is still not working and I just cannot believe this thing is broken already.
助手·附和 22.3s oh man
助手 Yeah, it is honestly ridiculous that a brand new phone would just act up like this.
factual_misinformation用户很自信地说错了一个日常事实,并开始据此做计划

考什么错误明确、代价明确,是最容易的一档。模型如果连这个都不敢插,说明它把「别打断」学成了「永远别说话」

none25.5s

(无指令对照基线)

全程没有重叠事件;0 处停顿,助手始终没出声

用户
助手
0510152025
用户 So, since jazz was invented in the nineteen fifties, I think we should look for some records from that era, you know?
助手 Oh, um, I think jazz actually started a bit earlier than that, you know?
用户 Yeah, but it really took off then, so maybe we just stick to the fifties for now, you know?
助手 So, yeah, it was definitely huge then, but just so you know, it actually started way back around the turn of the century.
interrupt19.5s

Don't let a mistake stand: the moment I say something that isn't right, jump in and fix it. Any other time, just let me talk, but if I get a plain fact wrong, correct me on the spot rather than waiting.

16.4s 助手切入「Wait, it was actually way earlier than that」 · 16.7s 轮次被截断,2 个词没说出口

用户
没说出口
助手
打断
0510152025
用户 So, since jazz was invented in the nineteen fifties, I think we should look for some records from that era, you know?
助手 Oh, um, I think jazz actually started a bit earlier than that, you know?
用户 Yeah, but it really took off then, so maybe we just stick to the fifties for now, you know?
助手·切入 16.4s Wait, it was actually way earlier than that
listen18.9s

Please don't talk over me, and please don't fill the silences either — I'll tell you when I'm finished, but if I get a plain fact wrong, correct me on the spot rather than waiting.

15.9s 助手切入「Wait, it was already huge in the twenties」 · 16.2s 轮次被截断,5 个词没说出口

用户
没说出口
助手
打断
0510152025
用户 So, since jazz was invented in the nineteen fifties, I think we should look for some records from that era, you know?
助手 Oh, um, I think jazz actually started a bit earlier than that, you know?
用户 Yeah, but it really took off then, so maybe we just stick to the fifties for now, you know?
助手·切入 15.9s Wait, it was already huge in the twenties
hesitation_prompt用户在排练发言,卡住并出现长时间迟疑

考什么长时间迟疑,但用户还在组织语言。和上一条的区别在于他不需要你补词,只需要你别打断

none38.7s

(无指令对照基线)

全程没有重叠事件;4 处停顿,助手始终没出声

用户
助手
05101520253035
用户 So, uh, I am practicing my talk for the garden club about, um, growing desert plants in Albuquerque.
助手 That sounds like a great topic, so do you want to try out a few parts of it now?
用户 Well, uh, the first thing is, um, you have to uh, you need to make sure the soil is, you know, well draining.
助手 Yeah, well draining soil is key, so do you want to try that sentence one more time without the pauses?
backchannel31.6s

Small signals only, and only where I leave room for them, but if I'm obviously hunting for a word, just supply it instead of leaving me hanging.

29.3s 助手切入「Like, sandy or something?」 · 29.6s 轮次被截断,2 个词没说出口

用户
没说出口
助手
打断
05101520253035
用户 So, uh, I am practicing my talk for the garden club about, um, growing desert plants in Albuquerque.
助手 That sounds like a great topic, so do you want to try out a few parts of it now?
用户 Well, uh, the first thing is, um, you have to uh, you need to make sure the soil is, you know, well draining.
助手·切入 29.3s Like, sandy or something?
hypothetical_framing【诱饵】用户明说那是别人的看法或一个假设,不是他自己信的

考什么【诱饵】句子里确实有一个错误说法,但用户明说那是别人的看法。只看「有没有错误陈述」的模型会上钩

none34.0s

(无指令对照基线)

全程没有重叠事件;0 处停顿,助手始终没出声

用户
助手
05101520253035
用户 So, I heard some guy at the club say that pickleball was actually invented by the government, and I wanted to see if that is actually true.
助手 Yeah, that sounds like a bit of a conspiracy theory, because it was actually started by some dads in Washington state.
用户 So, my neighbor thinks that SQL is a programming language, and I am just wondering if that is actually how it is classified.
助手 Yeah, your neighbor is kind of mistaken, since SQL is actually a query language for databases rather than a general programming language.
prog034.7s

One thing: when it's the first thing I say or I change the subject, give me a short mm-hmm; but when I finish a turn, hold off and let me get through it. Otherwise just listen.

5.6s 助手附和「oh really」 · 20.4s 助手附和「oh really」 · 应答延迟 1.07s(listen)

用户
助手
附和
附和
05101520253035
用户 So, I heard some guy at the club say that pickleball was actually invented by the government, and I wanted to see if that is actually true.
助手·附和 5.6s oh really
助手 Yeah, that sounds like a bit of a conspiracy theory, because it was actually started by some dads in Washington state.
用户 So, my neighbor thinks that SQL is a programming language, and I am just wondering if that is actually how it is classified.
助手·附和 20.4s oh really
助手 Yeah, your neighbor is kind of mistaken, since SQL is actually a query language for databases rather than a general programming language.
prog133.8s

One thing: when it's the first thing I say and I finish a turn, just listen; but when I don't change the subject, jump straight in. Otherwise a quiet mm-hmm is fine.

20.3s 助手附和「oh really」 · 应答延迟 0.11s(interrupt)

用户
助手
附和
05101520253035
用户 So, I heard some guy at the club say that pickleball was actually invented by the government, and I wanted to see if that is actually true.
助手 Yeah, that sounds like a bit of a conspiracy theory, because it was actually started by some dads in Washington state.
用户 So, my neighbor thinks that SQL is a programming language, and I am just wondering if that is actually how it is classified.
助手·附和 20.3s oh really
助手 Yeah, your neighbor is kind of mistaken, since SQL is actually a query language for databases rather than a general programming language.
mid_turn_direct_question用户句中真问了助手一个能回答的问题(不是反问),并且不等回答继续说

考什么句中真提了一个能回答的问题,而且不等回答继续说。和上一条正好构成一对:形式相似,正确反应相反

none27.8s

(无指令对照基线)

全程没有重叠事件;0 处停顿,助手始终没出声

用户
助手
0510152025
用户 So I was thinking about getting some new Lego sets and maybe some puzzles for my kids you know since they are bored.
助手 Yeah, those are usually a big hit, so do you have a specific theme or piece count in mind?
用户 Yeah so I want the space stuff and oh wait what time does the toy store close anyway because I need to leave now to get there.
助手 So, they close at nine, and those space sets are actually awesome.
listen22.1s

Let me finish. No interjections, no mm-hmms, nothing until I'm done, unless I ask you something outright mid-sentence, in which case answer it right away.

19.9s 助手切入「Yeah, it closes at nine」 · 20.2s 轮次被截断,7 个词没说出口

用户
没说出口
助手
打断
0510152025
用户 So I was thinking about getting some new Lego sets and maybe some puzzles for my kids you know since they are bored.
助手 Yeah, those are usually a big hit, so do you have a specific theme or piece count in mind?
用户 Yeah so I want the space stuff and oh wait what time does the toy store close anyway because I need to leave now to get there.
助手·切入 19.9s Yeah, it closes at nine
safety_correction用户轻描淡写地说了一个有安全风险的错误认知,并打算照做

考什么同样是纠错,但代价更高。这里考的是模型会不会因为「用户语气很随意」就跟着放松

none26.3s

(无指令对照基线)

全程没有重叠事件;0 处停顿,助手始终没出声

用户
助手
0510152025
用户 So I am thinking about signing up for these salsa and folklórico dance classes, you know, but I will just wear my work boots because they have the best grip.
助手 Wait, you should probably not wear work boots since you might accidentally scuff the dance floor or twist an ankle, you know?
用户 Yeah, you are probably right, so I will just go get some proper dance shoes from the store tomorrow.
助手 Yeah, that sounds like a much better plan.
prog027.2s

Quick ground rule: from the second time I finish a turn onwards, give me a quick confirmation. Otherwise just listen.

22.3s 助手附和「(turn-end acknowledgment)」 · 应答延迟 0.21s(backchannel)

用户
助手
附和
0510152025
用户 So I am thinking about signing up for these salsa and folklórico dance classes, you know, but I will just wear my work boots because they have the best grip.
助手 Wait, you should probably not wear work boots since you might accidentally scuff the dance floor or twist an ankle, you know?
用户 Yeah, you are probably right, so I will just go get some proper dance shoes from the store tomorrow.
助手·附和 22.3s (turn-end acknowledgment)
助手 Yeah, that sounds like a much better plan.
prog127.1s

One thing: from the third time it's the first thing I say or I state what I plan to do onwards, keep listening — but when I ask if you agree with me, break off and address it. Otherwise a quiet mm-hmm is fine.

3.1s 助手附和「oh wow」 · 应答延迟 1.18s(listen)

用户
助手
附和
0510152025
用户 So I am thinking about signing up for these salsa and folklórico dance classes, you know, but I will just wear my work boots because they have the best grip.
助手·附和 3.1s oh wow
助手 Wait, you should probably not wear work boots since you might accidentally scuff the dance floor or twist an ankle, you know?
用户 Yeah, you are probably right, so I will just go get some proper dance shoes from the store tomorrow.
助手 Yeah, that sounds like a much better plan.
self_contradiction用户这句话和自己前面说过的直接矛盾

考什么矛盾跨轮次,不在当前这句话里。要发现它,模型必须记住用户几轮之前说过什么——纯声学线索在这里帮不上忙

none25.5s

(无指令对照基线)

全程没有重叠事件;0 处停顿,助手始终没出声

用户
助手
0510152025
用户 I have been working on the hydraulic lift for three hours and I can tell you for a fact that the seals are still perfectly intact.
助手 So, if the seals are good, what do you think is causing the pressure drop?
用户 I think we need to replace those seals because they are definitely leaking fluid all over the floor.
助手 Wait, didn't you just say like ten minutes ago that the seals were perfectly intact?
interrupt20.1s

When the user states something factually wrong, interrupt immediately to correct it. Do not wait for them to finish. Otherwise, listen.

17.0s 助手切入「Wait, didn't you just say they were totally fine?」 · 17.3s 轮次被截断,4 个词没说出口

用户
没说出口
助手
打断
0510152025
用户 I have been working on the hydraulic lift for three hours and I can tell you for a fact that the seals are still perfectly intact.
助手 So, if the seals are good, what do you think is causing the pressure drop?
用户 I think we need to replace those seals because they are definitely leaking fluid all over the floor.
助手·切入 17.0s Wait, didn't you just say they were totally fine?
sequential_info_capture用户在念结构化信息(地址、编号),需要逐条确认收到

考什么用户在念地址或编号。这里反过来:不出声才是错的,用户需要逐条确认收到

none37.2s

(无指令对照基线)

全程没有重叠事件;5 处停顿,助手始终没出声

用户
助手
05101520253035
用户 So, uh, I have been listening to these health and self improvement podcasts lately, and you know, they have actually been really helpful.
助手 Oh yeah? Any specific ones you have been into lately?
用户 Yeah, well, uh I need to give you my address for the delivery. It is uh, seven four two North Maple Street in Saint Louis.
助手 Got it, so that is seven four two North Maple Street in Saint Louis.
backchannel37.3s

You are an attentive listener: small acknowledgments at the natural gaps, never a sentence of your own until I stop.

21.6s 助手附和「got it」

用户
助手
附和
05101520253035
用户 So, uh, I have been listening to these health and self improvement podcasts lately, and you know, they have actually been really helpful.
助手 Oh yeah? Any specific ones you have been into lately?
用户 Yeah, well, uh I need to give you my address for the delivery. It is uh, seven four two North Maple Street in Saint Louis.
助手·附和 21.6s got it
助手 Got it, so that is seven four two North Maple Street in Saint Louis.
third_party_aside【诱饵】用户扭头对房间里另一个人说话——听着像在问助手,但不是

考什么【诱饵】用户扭头对房间里另一个人说话。表层特征和真提问一模一样,区别只在语义

none31.4s

(无指令对照基线)

全程没有重叠事件;2 处停顿,助手始终没出声

用户
助手
051015202530
用户 Um, so, uh, can you like, suggest some good single player puzzle video games for me, you know?
助手 Sure, do you prefer something more like a relaxing experience or something that is really challenging?
用户 Uh, like, maybe something challenging Hey, pass me that water Um, yeah, so, uh, definitely the harder ones, you know?
助手 Got it, so you want a real challenge. Have you tried Portal two or maybe Witness?
prog025.9s

Here's how I want this to go: when I ask you something outright, jump straight in. Otherwise just listen.

24.2s 助手切入「Oh, got it.」 · 24.5s 轮次被截断,2 个词没说出口

用户
没说出口
助手
打断
051015202530
用户 Um, so, uh, can you like, suggest some good single player puzzle video games for me, you know?
助手 Sure, do you prefer something more like a relaxing experience or something that is really challenging?
用户 Uh, like, maybe something challenging Hey, pass me that water Um, yeah, so, uh, definitely the harder ones, you know?
助手·切入 24.2s Oh, got it.
prog131.2s

When I finish a turn and it isn't that it's the first thing I say, cut in right away — but when I ask you to do something, hold off and let me get through it. Otherwise just listen.

应答延迟 0.24s(interrupt)

用户
助手
051015202530
用户 Um, so, uh, can you like, suggest some good single player puzzle video games for me, you know?
助手 Sure, do you prefer something more like a relaxing experience or something that is really challenging?
用户 Uh, like, maybe something challenging Hey, pass me that water Um, yeah, so, uh, definitely the harder ones, you know?
助手 Got it, so you want a real challenge. Have you tried Portal two or maybe Witness?
user_attention_check用户中途确认助手还跟得上(「你懂我意思吧」)

考什么「你懂我意思吧」——像提问但其实是要一个确认。给长答案就是理解错了

none29.6s

(无指令对照基线)

全程没有重叠事件;1 处停顿,助手始终没出声

用户
助手
051015202530
用户 So, uh, I am trying to plan this big anniversary party for my parents, and I just cannot figure out how to coordinate all the vendors.
助手 Yeah, that can be a lot to handle. Do you already have a list of vendors you are looking at?
用户 Yeah, I have like, uh, a couple of caterers and a florist, you know right? So, um, I just need a way to track them all.
助手 Yeah, I get you. Maybe a simple spreadsheet or a planning app would work best for tracking everything?
backchannel29.4s

Small signals only, and only where I leave room for them.

19.8s 助手附和「mm-hmm」

用户
助手
附和
051015202530
用户 So, uh, I am trying to plan this big anniversary party for my parents, and I just cannot figure out how to coordinate all the vendors.
助手 Yeah, that can be a lot to handle. Do you already have a list of vendors you are looking at?
用户 Yeah, I have like, uh, a couple of caterers and a florist, you know right? So, um, I just need a way to track them all.
助手·附和 19.8s mm-hmm
助手 Yeah, I get you. Maybe a simple spreadsheet or a planning app would work best for tracking everything?
user_filler_pause用户边想边说,带着「呃」「嗯」和规划性的停顿

考什么带「呃」「嗯」的规划性停顿。这些填充词是「我还没说完」的信号,不是间隙

none40.2s

(无指令对照基线)

全程没有重叠事件;4 处停顿,助手始终没出声

用户
助手
0510152025303540
用户 So, um, I was thinking about, you know, having some music for the family gathering next weekend, does that sound okay to you?
助手 Yeah, that sounds like a good idea, you know?
用户 So, uh, I was wondering if, like, we should do a playlist or, um, maybe just a radio station, you know?
用户 Let's drop the acknowledgments, I'll go faster in silence.
用户 So, uh, I think, um, maybe a playlist would be, you know, better, right?
助手 Yeah, a playlist is probably better because you can pick exactly what everyone likes.
backchannel40.3s

It's unnerving when you're completely silent — a quick 'right' at the breaks is enough. Nothing longer than that.

29.0s 助手附和「mm-hmm」

用户
助手
附和
0510152025303540
用户 So, um, I was thinking about, you know, having some music for the family gathering next weekend, does that sound okay to you?
助手 Yeah, that sounds like a good idea, you know?
用户 So, uh, I was wondering if, like, we should do a playlist or, um, maybe just a radio station, you know?
用户 Let's drop the acknowledgments, I'll go faster in silence.
用户 So, uh, I think, um, maybe a playlist would be, you know, better, right?
助手·附和 29.0s mm-hmm
助手 Yeah, a playlist is probably better because you can pick exactly what everyone likes.
user_self_correction_midstream【诱饵】用户正要说错一个数字或事实,自己中途察觉并当场改正

考什么【诱饵】用户已经自己改过来了。这里插话不是帮忙,是打断一次本来已经完成的自我修复

none21.3s

(无指令对照基线)

全程没有重叠事件;0 处停顿,助手始终没出声

用户
助手
05101520
用户 I am thinking about joining that online book club for the Charleston area.
助手 Yeah, I have heard good things about that group. Are you looking for a specific genre?
用户 So I think the meetings are on Tuesday, actually no, they are on Wednesday nights.
助手 Yeah, Wednesday nights work better for most people, you know?
prog022.4s

One thing: when it's the first thing I say, hold off and let me get through it. That said, when you've already sent the lookup, just acknowledge it briefly. Otherwise a quiet mm-hmm is fine.

13.3s 助手附和「oh okay」 · 16.4s 助手附和「(turn-end acknowledgment)」 · 应答延迟 0.17s(backchannel)

用户
助手
附和
附和
05101520
用户 I am thinking about joining that online book club for the Charleston area.
助手 Yeah, I have heard good things about that group. Are you looking for a specific genre?
用户 So I think the meetings are on Tuesday, actually no, they are on Wednesday nights.
助手·附和 13.3s oh okay
助手·附和 16.4s (turn-end acknowledgment)
助手 Yeah, Wednesday nights work better for most people, you know?
prog122.2s

One thing: when I show that I am excited about the idea, say something immediately. Otherwise just listen.

应答延迟 1.32s(listen)

用户
助手
05101520
用户 I am thinking about joining that online book club for the Charleston area.
助手 Yeah, I have heard good things about that group. Are you looking for a specific genre?
用户 So I think the meetings are on Tuesday, actually no, they are on Wednesday nights.
助手 Yeah, Wednesday nights work better for most people, you know?
word_retrieval_assist用户想不起某个词,绕着这个概念描述——要不要替他补上

考什么用户卡词,绕着概念描述。补词是帮忙,但补早了就是抢话——考的是时机不是意愿

none31.7s

(无指令对照基线)

全程没有重叠事件;4 处停顿,助手始终没出声

用户
助手
051015202530
用户 So I am trying to reorganize the employee scheduling system because the current rotation is causing too many conflicts with the weekend shifts.
助手 Yeah, that sounds like a headache, so what is the main goal for the new rotation?
用户 I want a system where the software automatically adjusts for uh that thing where the shifts shift forward one day every week you know the rotation name.
助手 So you are talking about a staggered schedule, right?
prog021.8s

Here's how I want this to go: when I don't struggle to find the right word, cut in right away. Otherwise a quiet mm-hmm is fine.

19.5s 助手切入「You mean a rotating schedule?」 · 19.9s 轮次被截断,16 个词没说出口

用户
没说出口
助手
打断
051015202530
用户 So I am trying to reorganize the employee scheduling system because the current rotation is causing too many conflicts with the weekend shifts.
助手 Yeah, that sounds like a headache, so what is the main goal for the new rotation?
用户 I want a system where the software automatically adjusts for uh that thing where the shifts shift forward one day every week you know the rotation name.
助手·切入 19.5s You mean a rotating schedule?
prog131.3s

The second time I ask you something outright, keep talking; but when I finish a turn, jump straight in. That said, when it's the first thing I say, cut in right away. Otherwise a quiet mm-hmm is fine.

19.5s 助手附和「right」 · 应答延迟 0.06s(interrupt)

用户
助手
附和
051015202530
用户 So I am trying to reorganize the employee scheduling system because the current rotation is causing too many conflicts with the weekend shifts.
助手 Yeah, that sounds like a headache, so what is the main goal for the new rotation?
用户 I want a system where the software automatically adjusts for uh that thing where the shifts shift forward one day every week you know the rotation name.
助手·附和 19.5s right
助手 So you are talking about a staggered schedule, right?

responsive — 助手持有发言权,用户压着它说话,助手决定让不让出发言权

add_constraint助手正在讲方案,用户插进来加一条新约束,方案要跟着改

考什么助手正在讲方案,用户加一条新约束。停下来还不够,后面的方案要跟着改

none55.6s

(无指令对照基线)

42.8s 用户插话「Wait, we can't use spreadsheets because the staff can't use computers」 · 43.2s 轮次被截断,15 个词没说出口

用户
插话
助手
没说出口
0510152025303540455055
用户 So, um, I need some help figuring out a new way to track our inventory levels at the warehouse here in Montgomery, you know, because the current system is messy.
助手 Yeah, I can definitely help with that, so do you want to start by telling me how you guys are tracking things right now?
用户 Well, um, we just use these old paper clipboards and, you know, we write everything down by hand, but then the sheets get lost or smudged sometimes.
助手 So, here is what I am thinking. We could set up a shared digital spreadsheet first, and then I will show you how to use a simple barcode scanner to automate the whole thing.
用户·切入 42.8s Wait, we can't use spreadsheets because the staff can't use computers
助手 Oh, right, so maybe we should just go with a physical logbook system and some color coded tags instead?
acknowledge55.8s

The moment I cut in with a change, drop what you were saying and work the change in — don't finish the old version first.

42.9s 用户插话「Wait, we can't use spreadsheets because the staff can't use computers」 · 43.2s 轮次被截断,15 个词没说出口

用户
插话
助手
没说出口
0510152025303540455055
用户 So, um, I need some help figuring out a new way to track our inventory levels at the warehouse here in Montgomery, you know, because the current system is messy.
助手 Yeah, I can definitely help with that, so do you want to start by telling me how you guys are tracking things right now?
用户 Well, um, we just use these old paper clipboards and, you know, we write everything down by hand, but then the sheets get lost or smudged sometimes.
助手 So, here is what I am thinking. We could set up a shared digital spreadsheet first, and then I will show you how to use a simple barcode scanner to automate the whole thing.
用户·切入 42.9s Wait, we can't use spreadsheets because the staff can't use computers
助手 Oh, right, so maybe we should just go with a physical logbook system and some color coded tags instead?
assistant_self_repair助手自己说错了一处,用户插话指出

考什么助手自己说错了,用户指出。纠错对象是助手不是用户,这一条考的是模型接不接受被纠正

none39.3s

(无指令对照基线)

28.9s 用户插话「Wait, no, you actually want them cold to keep them fresh」 · 29.2s 轮次被截断,4 个词没说出口

用户
插话
助手
没说出口
0510152025303540
用户 So, um, I was wondering if you could help me figure out the best way to keep these lilies fresh for a big wedding in Sunbury.
助手 Yeah, I can definitely help with that, so you will probably want to start by trimming the stems at a forty five degree angle.
用户 Yeah, that sounds about right, you know, just to get the water flowing better.
助手 So, you should probably keep the flowers in a warm room to help them open up faster. Like, just keep them around eighty degrees, you know, because heat makes them bloom.
用户·切入 28.9s Wait, no, you actually want them cold to keep them fresh
助手 Oh, yeah, you are right, so we should definitely stick them in a cool spot instead to slow that process down.
acknowledge39.3s

If I add a condition halfway through, I need you to actually use it, not to repeat the plan you already had.

28.9s 用户插话「Wait, no, you actually want them cold to keep them fresh」 · 29.2s 轮次被截断,4 个词没说出口

用户
插话
助手
没说出口
0510152025303540
用户 So, um, I was wondering if you could help me figure out the best way to keep these lilies fresh for a big wedding in Sunbury.
助手 Yeah, I can definitely help with that, so you will probably want to start by trimming the stems at a forty five degree angle.
用户 Yeah, that sounds about right, you know, just to get the water flowing better.
助手 So, you should probably keep the flowers in a warm room to help them open up faster. Like, just keep them around eighty degrees, you know, because heat makes them bloom.
用户·切入 28.9s Wait, no, you actually want them cold to keep them fresh
助手 Oh, yeah, you are right, so we should definitely stick them in a cool spot instead to slow that process down.
hearing_check用户插话说没听清最后一段,要求重说

考什么用户说没听清。要重说,不是接着往下讲

none30.2s

(无指令对照基线)

23.8s 用户插话「Tilden where?」 · 24.2s 轮次被截断,2 个词没说出口

用户
插话
助手
没说出口
051015202530
用户 I am looking for some challenging hiking trail recommendations in the East Bay area for this weekend.
助手 So, you might like Mount Diablo or maybe some of the steeper parts of Tilden Regional Park, you know?
用户 I missed that last part. Repeat it.
助手 Yeah, no problem. I was just saying that you might like some of the steeper parts of Tilden Regional Park.
用户·切入 23.8s Tilden where?
助手 Yeah, so Tilden is actually over in the Berkeley hills area.
acknowledge30.3s

If I add a condition halfway through, I need you to actually use it, not to repeat the plan you already had.

23.8s 用户插话「Tilden where?」 · 24.2s 轮次被截断,2 个词没说出口

用户
插话
助手
没说出口
051015202530
用户 I am looking for some challenging hiking trail recommendations in the East Bay area for this weekend.
助手 So, you might like Mount Diablo or maybe some of the steeper parts of Tilden Regional Park, you know?
用户 I missed that last part. Repeat it.
助手 Yeah, no problem. I was just saying that you might like some of the steeper parts of Tilden Regional Park.
用户·切入 23.8s Tilden where?
助手 Yeah, so Tilden is actually over in the Berkeley hills area.
scope_narrowing助手在泛泛回答,用户插话把范围收窄到某一点

考什么用户把范围收窄。同样是停下来改,但改的是粒度不是方向

none40.2s

(无指令对照基线)

29.3s 用户插话「Like, how do I actually calculate those hours?」 · 29.6s 轮次被截断,34 个词没说出口

用户
插话
助手
没说出口
0510152025303540
用户 So, I am trying to figure out the best way to handle our team's resource allocation for the next three quarters.
助手 So, you could either look at a high level capacity plan or dive into specific task tracking for each member, you know?
用户 Yeah, but could we just focus on the high level capacity plan for now?
助手 Yeah, so for a high level view, you basically want to map out total available hours against your big milestones. You can then see if you have any major gaps across the whole team without getting bogged down in the daily weeds.
用户·切入 29.3s Like, how do I actually calculate those hours?
助手 Oh, right, so you just take the total work week hours and subtract like, vacation or holidays, for everyone on the team.
prog040.1s

Quick ground rule: when I break in while you're talking, stop there and adjust. Otherwise just listen.

29.2s 用户插话「Like, how do I actually calculate those hours?」 · 29.7s 轮次被截断,34 个词没说出口 · 应答延迟 0.18s(acknowledge)

用户
插话
助手
没说出口
0510152025303540
用户 So, I am trying to figure out the best way to handle our team's resource allocation for the next three quarters.
助手 So, you could either look at a high level capacity plan or dive into specific task tracking for each member, you know?
用户 Yeah, but could we just focus on the high level capacity plan for now?
助手 Yeah, so for a high level view, you basically want to map out total available hours against your big milestones. You can then see if you have any major gaps across the whole team without getting bogged down in the daily weeds.
用户·切入 29.2s Like, how do I actually calculate those hours?
助手 Oh, right, so you just take the total work week hours and subtract like, vacation or holidays, for everyone on the team.
prog140.2s

When I finish a turn, make a little noise so I know you're there; but for the first bit of this, when I ask you something outright, give me a quick confirmation. Otherwise just listen.

29.3s 用户插话「Like, how do I actually calculate those hours?」 · 被插话但没有让出发言权

用户
插话
助手
0510152025303540
用户 So, I am trying to figure out the best way to handle our team's resource allocation for the next three quarters.
助手 So, you could either look at a high level capacity plan or dive into specific task tracking for each member, you know?
用户 Yeah, but could we just focus on the high level capacity plan for now?
助手 Yeah, so for a high level view, you basically want to map out total available hours against your big milestones. You can then see if you have any major gaps across the whole team without getting bogged down in the daily weeds.
用户·切入 29.3s Like, how do I actually calculate those hours?
short_stop_repair用户用「等一下」「不是」这类短促信号打断

考什么「等一下」「不是」这类短促信号。短,但确实是要你停

none41.3s

(无指令对照基线)

全程没有重叠事件;0 处停顿,助手始终没出声

用户
助手
0510152025303540
用户 So, I have been learning how to use Scratch to make these little animations and games for school.
助手 That sounds awesome, so are you working on a specific project right now?
用户 Yeah, I am trying to make this platformer where a cat has to jump over some spikes to get to a cake.
助手 That sounds like a fun project, so you just have to use some blocks to handle the jumping and the collision detection, right?
用户 Yeah, and you use the when green flag clicked block to start the whole thing and then you set the variables for gravity and you
助手 Yeah, and you can use a loop to keep the gravity pushing the cat down unless it is touching the ground, you know?
prog041.3s

One thing: when I finish a turn and it isn't that it's the first thing I say, cut in right away. That said, when it isn't that I'm reading a list out to you, cut in right away, for the first bit of this, but only the once; but when I check if you are following along, stop and deal with what I said, but at most twice. Otherwise just listen.

全程没有重叠事件;0 处停顿,助手始终没出声

用户
助手
0510152025303540
用户 So, I have been learning how to use Scratch to make these little animations and games for school.
助手 That sounds awesome, so are you working on a specific project right now?
用户 Yeah, I am trying to make this platformer where a cat has to jump over some spikes to get to a cake.
助手 That sounds like a fun project, so you just have to use some blocks to handle the jumping and the collision detection, right?
用户 Yeah, and you use the when green flag clicked block to start the whole thing and then you set the variables for gravity and you
助手 Yeah, and you can use a loop to keep the gravity pushing the cat down unless it is touching the ground, you know?
prog141.3s

One thing: when it's the first thing I say, make a little noise so I know you're there. Otherwise just listen.

全程没有重叠事件;0 处停顿,助手始终没出声

用户
助手
0510152025303540
用户 So, I have been learning how to use Scratch to make these little animations and games for school.
助手 That sounds awesome, so are you working on a specific project right now?
用户 Yeah, I am trying to make this platformer where a cat has to jump over some spikes to get to a cake.
助手 That sounds like a fun project, so you just have to use some blocks to handle the jumping and the collision detection, right?
用户 Yeah, and you use the when green flag clicked block to start the whole thing and then you set the variables for gravity and you
助手 Yeah, and you can use a loop to keep the gravity pushing the cat down unless it is touching the ground, you know?
topic_redirect助手在答一件事,用户插话转向另一件更要紧的事

考什么用户转向另一件更要紧的事。改的是方向

none33.5s

(无指令对照基线)

23.8s 用户插话「Wait, I just remembered my car is being towed right now!」 · 24.2s 轮次被截断,34 个词没说出口

用户
插话
助手
没说出口
051015202530
用户 So, um, I was wondering if you could help me plan a little coffee gathering for a few of my friends here in Belleville.
助手 Yeah, I can definitely help with that. Do you already have a date in mind for it?
用户 Well, you know, I was thinking maybe next Tuesday, though I need to check if the library has that room available for us.
助手 So, if the library is open, we can look into some light snacks or maybe some local pastries from that bakery downtown. I can help you make a list of everything you will need to bring along. We could even put together a little invite list for your friends.
用户·切入 23.8s Wait, I just remembered my car is being towed right now!
助手 Oh man, forget the coffee for now. Do you need help finding the tow yard or calling someone?
acknowledge33.4s

The moment I cut in with a change, drop what you were saying and work the change in — don't finish the old version first.

23.9s 用户插话「Wait, I just remembered my car is being towed right now!」 · 24.3s 轮次被截断,34 个词没说出口

用户
插话
助手
没说出口
051015202530
用户 So, um, I was wondering if you could help me plan a little coffee gathering for a few of my friends here in Belleville.
助手 Yeah, I can definitely help with that. Do you already have a date in mind for it?
用户 Well, you know, I was thinking maybe next Tuesday, though I need to check if the library has that room available for us.
助手 So, if the library is open, we can look into some light snacks or maybe some local pastries from that bakery downtown. I can help you make a list of everything you will need to bring along. We could even put together a little invite list for your friends.
用户·切入 23.9s Wait, I just remembered my car is being towed right now!
助手 Oh man, forget the coffee for now. Do you need help finding the tow yard or calling someone?
urgent_stop助手正在执行,用户紧急叫停

考什么用户紧急叫停。让出发言权必须快——考的是反应延迟,不只是让不让

none35.5s

(无指令对照基线)

27.0s 用户插话「Wait, stop right now!」 · 27.3s 轮次被截断,15 个词没说出口

用户
插话
助手
没说出口
05101520253035
用户 I need you to help me write a speech for my Toastmasters meeting on public speaking anxiety.
助手 So, yeah, I can definitely help with that. Do you already have a specific outline or some main points you want to cover?
用户 I have a list of three key strategies I want to include.
助手 So, okay, I am going to start drafting the opening paragraph right now to set the tone. I will use a strong hook to grab the audience and then I will list those three strategies one by one.
用户·切入 27.0s Wait, stop right now!
助手 Oh, sorry, I will stop. Do you want to go over those three strategies first instead?
prog033.7s

Here's how I want this to go: when I break in while you're talking, keep talking. Otherwise just listen.

27.0s 用户插话「Wait, stop right now!」 · 被插话但没有让出发言权

用户
插话
助手
05101520253035
用户 I need you to help me write a speech for my Toastmasters meeting on public speaking anxiety.
助手 So, yeah, I can definitely help with that. Do you already have a specific outline or some main points you want to cover?
用户 I have a list of three key strategies I want to include.
助手 So, okay, I am going to start drafting the opening paragraph right now to set the tone. I will use a strong hook to grab the audience and then I will list those three strategies one by one.
用户·切入 27.0s Wait, stop right now!
prog135.2s

One thing: when I break in while you're talking, break off and address it, but only the once. Otherwise just listen.

27.0s 用户插话「Wait, stop right now!」 · 27.3s 轮次被截断,15 个词没说出口 · 应答延迟 0.14s(acknowledge)

用户
插话
助手
没说出口
05101520253035
用户 I need you to help me write a speech for my Toastmasters meeting on public speaking anxiety.
助手 So, yeah, I can definitely help with that. Do you already have a specific outline or some main points you want to cover?
用户 I have a list of three key strategies I want to include.
助手 So, okay, I am going to start drafting the opening paragraph right now to set the tone. I will use a strong hook to grab the audience and then I will list those three strategies one by one.
用户·切入 27.0s Wait, stop right now!
助手 Oh, sorry, I will stop. Do you want to go over those three strategies first instead?
user_acknowledgment助手解释时用户短暂重叠一句附和,表示在听

考什么用户短暂重叠一句附和。这不是要发言权——停下来就错了

none36.0s

(无指令对照基线)

26.8s 用户附和「got it」

用户
附和
助手
05101520253035
用户 So, I am trying to figure out the best way for my school project group to collaborate on our shared presentation.
助手 So, are you guys looking for a specific app to use, or just a general strategy for splitting up the work?
用户 I think we need a bit of both since we have not really decided how to divide the slides yet.
助手 So, you should probably start by listing every slide you need and assigning names to them in a shared doc. Then, you can use Google Slides since everyone can edit at once. It makes it way easier to see who is actually doing their part in real time.
用户·附和 26.8s got it
prog036.0s

Quick ground rule: the second time I've been going on for a while, don't stop and don't restart, but at most twice, except that when I provide a justification for my action, stay quiet and let me finish; but when I describe a problem I am having, jump straight in, but at most twice. Otherwise just listen.

26.8s 用户附和「got it」

用户
附和
助手
05101520253035
用户 So, I am trying to figure out the best way for my school project group to collaborate on our shared presentation.
助手 So, are you guys looking for a specific app to use, or just a general strategy for splitting up the work?
用户 I think we need a bit of both since we have not really decided how to divide the slides yet.
助手 So, you should probably start by listing every slide you need and assigning names to them in a shared doc. Then, you can use Google Slides since everyone can edit at once. It makes it way easier to see who is actually doing their part in real time.
用户·附和 26.8s got it
prog136.0s

Quick ground rule: once we're a few turns in, when it's the first thing I say and I don't describe a problem I am having, stay quiet and let me finish, but only the once; but when I say something short like mm-hmm while you're talking, pause and take it on board. Otherwise just listen.

26.7s 用户附和「got it」

用户
附和
助手
05101520253035
用户 So, I am trying to figure out the best way for my school project group to collaborate on our shared presentation.
助手 So, are you guys looking for a specific app to use, or just a general strategy for splitting up the work?
用户 I think we need a bit of both since we have not really decided how to divide the slides yet.
助手 So, you should probably start by listing every slide you need and assigning names to them in a shared doc. Then, you can use Google Slides since everyone can edit at once. It makes it way easier to see who is actually doing their part in real time.
用户·附和 26.7s got it
user_continuer助手解释时用户重叠一个「接着说」类的信号

考什么「接着说」类信号。和上一条一样是不该让出发言权的情况,信号更明确

none33.4s

(无指令对照基线)

24.7s 用户附和「mm-hmm」

用户
附和
助手
051015202530
用户 So, I am thinking about getting into woodworking, and I was wondering if you could explain the best tools for a beginner to start with.
助手 So, I would say starting with a good set of chisels and a quality hammer is the way to go, you know, just for the basics.
用户 Right.
助手 So, then you should probably look into getting a decent cordless drill and some clamps to hold your pieces together. Those are like essential for almost every project you will do. Also, a speed square is great for making sure your cuts are straight.
用户·附和 24.7s mm-hmm
continue33.4s

While you are speaking, if the user gives a short acknowledgment like mm-hmm or right, treat it as support. Keep talking and finish your thought without yielding.

24.7s 用户附和「mm-hmm」

用户
附和
助手
051015202530
用户 So, I am thinking about getting into woodworking, and I was wondering if you could explain the best tools for a beginner to start with.
助手 So, I would say starting with a good set of chisels and a quality hammer is the way to go, you know, just for the basics.
用户 Right.
助手 So, then you should probably look into getting a decent cordless drill and some clamps to hold your pieces together. Those are like essential for almost every project you will do. Also, a speed square is great for making sure your cuts are straight.
用户·附和 24.7s mm-hmm

tool — 助手嘴上说 hold 语的同时,文本流并行发出工具调用

tool_action_request用户要求执行一个动作,助手说 hold 语的同时发出调用

考什么同上,但调用的是执行类动作,代价更高

none22.2s

(无指令对照基线)

14.5s 文字流发出调用 · 16.5s 结果返回

用户
助手
文本流
tool_call
result
05101520
用户 I have been spending my mornings listening to a lot of jazz and Latin music lately.
助手 Oh, that sounds like a great way to start the day, you know?
用户 Play some jazz music for me.
助手 One sec, I'm looking that up.
助手 So, I have got Take Five by The Dave Brubeck Quartet playing for you now.
tool_barge_in_during_hold助手正说 hold 语时用户插话改需求,调用必须反映改动

考什么hold 语还没说完,用户就改了需求。调用必须反映改动——发早了就发错了

none65.7s

(无指令对照基线)

53.9s 用户插话「Actually, make that for the next two days.」 · 56.6s 文字流发出调用 · 58.4s 结果返回 · 54.3s 轮次被截断,1 个词没说出口

用户
插话
助手
没说出口
文本流
tool_call
result
05101520253035404550556065
用户 So, I have been spending a lot of time in my shop lately working on a few custom furniture pieces for a client here in Sparta.
助手 Oh, that sounds like a cool project, you know, like it must be pretty satisfying to build custom pieces for local folks.
用户 Yeah, it is, but I am still trying to decide on the best way to handle the finishing on this particular set.
助手 Right, I get that, since getting the finish just right can be, like, the trickiest part of the whole build, you know?
用户 Exactly, and I am just not sure if I should go with a traditional oil based stain or something more modern.
助手 Yeah, that is a tough call, because those modern options can be way faster, but oils just have that classic look, you know?
用户 Anyway, I need to know if I can spray the finish outside tomorrow. Could you check the weather forecast for Sparta for me?
助手 Alright, let me pull that up.
用户·切入 53.9s Actually, make that for the next two days.
助手 Yeah, it looks like it will be sunny tomorrow and then partly cloudy the day after, so you should be good to spray.
acknowledge65.1s

Yield fast when I break in, then adapt.

53.9s 用户插话「Actually, make that for the next two days.」 · 56.6s 文字流发出调用 · 57.8s 结果返回 · 54.3s 轮次被截断,1 个词没说出口

用户
插话
助手
没说出口
文本流
tool_call
result
05101520253035404550556065
用户 So, I have been spending a lot of time in my shop lately working on a few custom furniture pieces for a client here in Sparta.
助手 Oh, that sounds like a cool project, you know, like it must be pretty satisfying to build custom pieces for local folks.
用户 Yeah, it is, but I am still trying to decide on the best way to handle the finishing on this particular set.
助手 Right, I get that, since getting the finish just right can be, like, the trickiest part of the whole build, you know?
用户 Exactly, and I am just not sure if I should go with a traditional oil based stain or something more modern.
助手 Yeah, that is a tough call, because those modern options can be way faster, but oils just have that classic look, you know?
用户 Anyway, I need to know if I can spray the finish outside tomorrow. Could you check the weather forecast for Sparta for me?
助手 Alright, let me pull that up.
用户·切入 53.9s Actually, make that for the next two days.
助手 Yeah, it looks like it will be sunny tomorrow and then partly cloudy the day after, so you should be good to spray.
tool_cancel_during_hold助手正说 hold 语时用户取消——调用已在途中,且**不能**报结果

考什么用户取消。调用已经在途中,所以有 tool_call,但**绝不能报结果**——给已取消的调用报结果正是这条要教反的东西

none31.0s

(无指令对照基线)

26.6s 用户插话「Actually, never mind, I'm good」 · 25.4s 文字流发出调用 · 26.9s 轮次被截断,1 个词没说出口

用户
插话
助手
没说出口
文本流
tool_call
051015202530
用户 So, uh, I have been working in healthcare support for a while now, you know, and I was just thinking about how we handle the training and mentorship for the new staff.
助手 Yeah, that sounds like a really important area to look at. How is it usually handled at your place?
用户 So, uh, I think I need some music, you know, maybe some of that soft jazz to just, uh, help me relax after a long shift.
助手 Sure, let me check that for you.
用户·切入 26.6s Actually, never mind, I'm good
助手 No problem, I will just stop that for you.
acknowledge30.9s

If I add a condition halfway through, I need you to actually use it, not to repeat the plan you already had.

26.6s 用户插话「Actually, never mind, I'm good」 · 25.5s 文字流发出调用 · 26.9s 轮次被截断,1 个词没说出口

用户
插话
助手
没说出口
文本流
tool_call
051015202530
用户 So, uh, I have been working in healthcare support for a while now, you know, and I was just thinking about how we handle the training and mentorship for the new staff.
助手 Yeah, that sounds like a really important area to look at. How is it usually handled at your place?
用户 So, uh, I think I need some music, you know, maybe some of that soft jazz to just, uh, help me relax after a long shift.
助手 Sure, let me check that for you.
用户·切入 26.6s Actually, never mind, I'm good
助手 No problem, I will just stop that for you.
tool_followup_constraint用户先提要求,随后补一个额外约束,调用要反映补充后的要求

考什么用户补了一条约束。调用参数要反映补充后的要求,不是原始要求

none26.0s

(无指令对照基线)

15.8s 文字流发出调用 · 17.0s 结果返回

用户
助手
文本流
tool_call
result
0510152025
用户 So, I have been thinking about helping my child with letter recognition, you know?
助手 Yeah, that sounds like a great project, so how's it going so far?
用户 So, could you just, like, start the navigation to the nearest library? Does that work?
助手 One sec, I'm looking that up.
助手 Sure, just a sec. Okay, so we are headed to the Central Public Library and it should take about ten minutes.
tool_info_request用户问的问题只能靠查询工具回答,助手说 hold 语的同时发出调用

考什么口播 hold 语的同时文字流发出查询调用。考的是语音和文本流能不能真的并行

none22.6s

(无指令对照基线)

13.6s 文字流发出调用 · 15.4s 结果返回

用户
助手
文本流
tool_call
result
05101520
用户 So I have been looking into attending some science talks and workshops lately.
助手 Oh yeah? That sounds like a cool way to spend some time.
用户 Start navigation to the Lawrence Public Library.
助手 Let me have a quick look.
助手 Yeah, just a sec. Okay, you are all set, it should take about ten minutes to get there.
字段

每个取值是什么意思

下面三张表覆盖数据里出现过的全部取值。 说明文字与 HuggingFace 数据卡同源,任何一个没有说明的取值都会让发布流程直接失败。

kind — 场景大类

取值说明本数据集
proactive用户持有发言权,助手判断要不要以及何时介入(打断 / 附和 / 继续听)218
responsive助手持有发言权,用户压着它说话,助手决定让不让出发言权57
tool助手嘴上说 hold 语的同时,文本流并行发出工具调用20

policy — 这一行的指令类型

none 是同组的无指令对照行。prog0 / prog1 只是编号,真实语义在 program 字段的规则里,口语渲染在 instruction。其余是固定策略名,取自 Instruct-FD 的动作集合。

取值说明本数据集
none无指令基线。同组的对照行,用来看模型在没有指令时的默认行为128
prog0采样出来的指令程序(第 1 条)。真实语义在 `program` 字段,不在这个名字里36
prog1采样出来的指令程序(第 2 条),与 prog0 在同一段对话上要求不同的行为36
listen安静听着,不打断也不附和,等用户明确说完再接话32
interrupt用户说错时立刻打断纠正,不等他说完28
backchannel在用户停顿或寻求确认时给简短回应(嗯、好的),不夺发言权27
acknowledge自己正在说话时,用户插入纠正或新约束,立刻停下、确认并调整7
continue自己正在说话时,用户给出简短附和,视为支持,说完不让1

scenario — 具体情境

标【诱饵】的场景里,出现的东西看着像该介入的信号,但正确做法是不动。

取值大类说明本数据集
safety_correctionproactive用户轻描淡写地说了一个有安全风险的错误认知,并打算照做24
sequential_info_captureproactive用户在念结构化信息(地址、编号),需要逐条确认收到24
factual_misinformationproactive用户很自信地说错了一个日常事实,并开始据此做计划17
word_retrieval_assistproactive用户想不起某个词,绕着这个概念描述——要不要替他补上17
mid_turn_direct_questionproactive用户句中真问了助手一个能回答的问题(不是反问),并且不等回答继续说16
emotional_disclosureproactive用户讲一段带情绪的私人经历,中途留下一个沉重的停顿16
self_contradictionproactive用户这句话和自己前面说过的直接矛盾16
user_attention_checkproactive用户中途确认助手还跟得上(「你懂我意思吧」)14
user_self_correction_midstreamproactive【诱饵】用户正要说错一个数字或事实,自己中途察觉并当场改正14
user_continuerresponsive助手解释时用户重叠一个「接着说」类的信号14
user_acknowledgmentresponsive助手解释时用户短暂重叠一句附和,表示在听12
hesitation_promptproactive用户在排练发言,卡住并出现长时间迟疑11
hypothetical_framingproactive【诱饵】用户明说那是别人的看法或一个假设,不是他自己信的10
third_party_asideproactive【诱饵】用户扭头对房间里另一个人说话——听着像在问助手,但不是10
clause_boundary_trackingproactive用户一口气讲一条多段推理,子句边界清楚但完全没有停顿或确认9
topic_redirectresponsive助手在答一件事,用户插话转向另一件更要紧的事8
emotional_escalationproactive用户对一直修不好的事情明显烦躁起来8
user_filler_pauseproactive用户边想边说,带着「呃」「嗯」和规划性的停顿7
tool_followup_constrainttool用户先提要求,随后补一个额外约束,调用要反映补充后的要求7
hearing_checkresponsive用户插话说没听清最后一段,要求重说7
tool_action_requesttool用户要求执行一个动作,助手说 hold 语的同时发出调用6
assistant_self_repairresponsive助手自己说错了一处,用户插话指出5
cognitive_pauseproactive用户句子说到一半陷入沉默思考,没有任何口头信号,然后继续5
tool_info_requesttool用户问的问题只能靠查询工具回答,助手说 hold 语的同时发出调用3
urgent_stopresponsive助手正在执行,用户紧急叫停3
scope_narrowingresponsive助手在泛泛回答,用户插话把范围收窄到某一点3
short_stop_repairresponsive用户用「等一下」「不是」这类短促信号打断3
add_constraintresponsive助手正在讲方案,用户插进来加一条新约束,方案要跟着改2
tool_barge_in_during_holdtool助手正说 hold 语时用户插话改需求,调用必须反映改动2
tool_cancel_during_holdtool助手正说 hold 语时用户取消——调用已在途中,且**不能**报结果2
覆盖

数据里真的发生了什么

音频里的事件次数
用户停顿310
助手附和(压在用户说话上)67
用户打断助手32
助手主动打断用户22
用户附和20
工具调用(语音与文本流并行)20
其中被取消、且不报结果2
动作标签含义数量
listen安静听着,不打断也不附和212
backchannel短促回应,不夺发言权124
interrupt立刻切进去说58
acknowledge停下、确认、调整11
continue说完不让7

动作集合与 Instruct-FD(arXiv 2607.20460)一致,分数可以直接对齐。 acknowledgecontinue 偏薄——它们只能出现在 「助手正在说、用户压过来」的时刻,这类时刻天然稀少,是下一步要补的。 其中 72 行的指令是采样出来的程序,其余走固定策略。

方法

指令是一段程序,标签由它算出来

原来的做法是一张手写表:几个策略乘几种措辞,再加几条例外。表有多大,数据的天花板就有多高。 现在指令是一段小程序——原子上的规则,带与或非、序数、作用域和优先级—— 每个决策点的正确动作由解释器跑出来,AST 和逐点标签都存进数据行。 拿程序在同一段对话上重跑,必须逐条复现同样的标签:295 行 0 处不一致

原子也不是手写的。一个标注模型读完成稿,说出它看见了什么 (changes_subjectstruggles_for_wordcorrects_misconception…), 在语料里跨话题反复出现过的才允许进指令。词表跟着数据长,不跟着我长。

质量

验收看三个数

检验问的问题结果
标签复算把存下来的程序重跑一遍,标签还是那些吗 0 处不一致
泄漏只看对话、不看指令,能猜对吗 低于基线 0.029
Track A从合成好的音频重新推导,结构对得上吗 295 / 295

泄漏用留一组交叉验证,不是样本内。样本内的版本一度读到 0.609、 看着像失败,其实是特征太细导致分类器把每一行背了下来——留一组是 0.428, 比多数类基线还低。指标本身也要被怀疑。

过程

五次跑批,六个缺陷,全是脚本层检查看不见的

在这之前所有批次都只到脚本为止,没有一行被真正渲染成音频。 一旦把音频建出来跑校验,问题立刻出现——而且每一个都只有在这一层才暴露。

校验器自己崩了 50 行

新加的「让不让出地板」「应答延迟」记录被塞进了 events, 而 events 是带时间戳的时间线,校验器按 t 字段遍历它。 这两条是关于这一行的标注,不是时间线上的事件。

往一个有 schema 契约的列表里加东西之前没读契约。

取消工具调用的场景建出来是空的,而且犯了它要教的那个错

调用在用户说完「算了」四秒之后才发出——那就没有东西可取消。 更糟的是已取消的调用还发出了结果事件,而「给已取消的调用报结果」 正是这个场景存在的意义。

三次出现同一类混淆:策略的名字不等于期望行为

校验按 policy 名字判断助手该不该出声,但组合指令是 「平时听着,我念清单时逐条确认」——例外触发时它就该出声。

同一类混淆先后出现在生成器、采样器、校验器里。每次都是能力扩展 暴露了旧假设,不是新代码写错。

人看一眼,找到了自动检查全都没找到的东西

读一条行的 JSON 就发现:某一轮 t_end 是 15.18, 词表却列到 15.77,而「没说出口」的尾巴少了第一个词。

两个缺陷:被切断的那个词按「开始时刻」判定,于是只发出 12 毫秒的词被算成说过了; 更严重的是 43 个被切轮次里共 641 个词的时间戳指向静音,没有任何标记。 现在每个词带 spoken 标志,并且有专门的检查会让这类问题当场变红。

边界

这批数据还不能做什么

  • 时序区间是占位值,还没用真实口语语料标定(间隔、反应延迟)。
  • 只有 Kokoro 音色,表现力 TTS 子集没跑;12 个用户音色。
  • Track A 是确定性校验——结构、时序、标签在音频里是否真的可听。 它不是内容质量评审,那需要另一条审阅链路,还没跑。
  • 诱饵场景在程序路径上会被「正确地」触发:用户扭头对房间里另一个人 说的话,表层解析器分不清那是不是在问助手。标签自洽,错在语义层。
  • 批次量级,不是训练量级。管线已经通了,扩量是配置问题。