AI Meeting Note Takers: From Transcript to Tasks
An AI note taker transcribes a meeting and drafts a summary with action items. How the built-in tools in Zoom, Teams and Google Meet and the bots from Otter and Fireflies work, what US recording-consent law means in plain terms, where the summaries go wrong, and how to turn the actions into tasks someone owns.
7 min read
An AI meeting note taker listens to a video call, turns the speech into a transcript, and uses a language model to draft a summary, a list of topics and suggested action items. Some are built into the meeting app (Zoom AI Companion, Microsoft Teams intelligent recap, Google Meet’s “Take notes for me”); others join as a bot participant from your calendar (Otter, Fireflies). All of them produce a draft, not a record. Before anything is filed, a person checks the decisions and actions against what was actually agreed, makes sure everyone knew the meeting was being recorded, and turns each action into a task with one owner. This guide covers each of those steps.
How AI note takers work
There are two designs. A built-in note taker runs inside the meeting platform, so it hears the meeting the way the platform does and needs no extra participant. A bot note taker joins the call as a participant, records the audio, and does its work in its own service; that lets one tool cover Zoom, Teams and Meet, at the cost of a visible extra attendee who may need to be let in from a waiting room. Either way the output is the same shape: transcript, summary, action items, and a way to share them.
What the main tools do, as their vendors document them
The list below is alphabetical by platform, not a ranking. Features and licensing change often, so check each vendor’s page for your plan before you rely on a detail.
- Zoom AI Companion meeting summary: according to Zoom’s support article (opens in a new tab), the host or a co-host starts or stops it from the in-meeting controls, an indicator shows participants that AI features are active, and the summary is built from speech-to-text data and sent by email and, where enabled, to the meeting’s group chat.
- Microsoft Teams intelligent recap: the Recap tab shows AI notes and follow-up tasks, name mentions and timeline markers. Microsoft’s recap page (opens in a new tab) says AI notes need the meeting to be transcribed and at least five minutes long, and many of these features need a Teams Premium or Microsoft Copilot license.
- Google Meet “Take notes for me”: Google’s help page (opens in a new tab) says the notes are written to a Google Doc in the organizer’s Drive, the host chooses who receives them, and Meet tells every participant that notes are being taken, with a pencil icon on their screens.
- Otter Notetaker: Otter’s settings article (opens in a new tab) describes a Notetaker that can auto-join calendar events with a Zoom, Google Meet or Microsoft Teams link, optionally email calendar guests before the meeting that it will join and record, and post a summary and action items in the meeting chat before the meeting ends.
- Fireflies: its knowledge base says the Fireflies.ai Notetaker joins from auto-join settings, a calendar invite or a live link, records audio by default, stays visible in the participant list, and can show a pre-meeting disclaimer if you turn on its Meeting Compliance setting.
If you are choosing the best AI meeting note taker for your team, the useful questions are not about summary quality, which changes with every model update. Ask where the transcript and notes are stored and who can see them, whether participants are told and how, whether it works on the platforms your clients use, whether an administrator can control it, and whether the action items can leave the tool in a form you can file.
Consent and recording law, in plain terms
This is general information, not legal advice. Federal law allows a recording when one party to the conversation consents: 18 U.S.C. 2511(2)(d) (opens in a new tab) says it is not unlawful for a person to intercept a communication “where such person is a party to the communication or where one of the parties to the communication has given prior consent,” unless it is done to commit a crime or tort. States add their own rules on top, and they differ.
Some states require the consent of everyone on the call. California Penal Code 632 (opens in a new tab), for example, makes it an offense to record a confidential communication “without the consent of all parties.” A video call routinely includes people in different states, and sometimes different countries, so the safe habit is to act as if every participant must agree.
- Say it at the start, out loud, even if the tool shows an icon: “This meeting is being transcribed by an AI note taker. Tell me now if you would rather it was not.”
- Put it in the invite for meetings with clients, candidates or anyone outside your organization.
- Turn off auto-join for meetings where a bot should never be present, such as HR conversations, legal matters or anything under a confidentiality agreement.
- Know where the recording and transcript go, how long they are kept and who can open them, because someone will ask.
- For anything regulated or sensitive, ask your counsel which state laws apply to your calls before you switch a note taker on by default.
Accuracy limits
The vendors say it themselves. Microsoft’s recap documentation warns that some AI-generated content “might be inaccurate, incomplete, or inappropriate,” and Google says a Meet summary can be incomplete, inaccurate or not generated at all, for example in very short meetings. In practice the errors cluster in predictable places:
- Who said what. Crosstalk, a shared conference room microphone and similar voices all confuse speaker labels, and an action item attached to the wrong person is worse than none.
- Proposals recorded as decisions. “We could move the launch” and “we are moving the launch” can come out the same in a summary.
- Numbers, names and dates. Product names, customer names and figures read aloud are where transcription slips most.
- What was not said. Agreements reached in a side chat, on a whiteboard or after the call are missing, and the summary reads as complete anyway.
- Suggested action items are suggestions. A tool may list something as an action because someone mentioned it, not because anyone agreed to do it.
The fix is a short human pass, done by someone who was in the meeting, before anything leaves the tool. Check each decision and each action against memory, correct the owner, delete what was never agreed, and rewrite the rest into the shape of the meeting minutes template: decisions, action items with one owner each, and open questions. That takes five minutes and turns a transcript into a record.
From transcript to tasks
An action item that stays inside the note taker gets done only by people who reopen the summary. Move each checked action onto the board the team works from, and each decision somewhere it can be found. There are two ways to do that with fenbs.
- By hand. Copy the checked action items into Add many as a Markdown list. Each line becomes a task; lines indented under it become its note, so put the owner, the date and the meeting there. fenbs has no assignee field and no due dates, which is why they go in the note.
- With an AI assistant. Paste the checked notes into Claude, ChatGPT or another assistant connected to the board over MCP, and ask it to file each action with
fenbs_create_itemand each decision withfenbs_add_decision. Ask it to show you the list first and file only what you approve.
Here are the checked notes from today's website team meeting: [paste]. 1. List each action item as a task title, with the owner, the date and a one-line note saying which meeting it came from. Show me the list. 2. List each decision with who decided it. Anything nobody decided is an open question. 3. When I say go, create the tasks with fenbs_create_item and record the decisions with fenbs_add_decision: decided only where a named person decided it in the meeting, open otherwise. Do not decide anything yourself.
Decisions land on the Decisions and rules page with the person who decided as the decider, never the assistant. Anything that holds from now on, such as “no AI note takers in client legal calls”, is worth recording as a rule, because every connected AI assistant reads the rules before it starts work. The assistant acts with the scopes you gave it, and every task it files is recorded under its name in the task’s history.
Related
The format to rewrite a summary into: meeting minutes template. A reusable skill for sorting notes: Claude skills for project management. Checking anything an assistant drafts: verifying AI-generated work. Connecting an assistant: MCP setup docs.