Best AI Meeting Minutes Software Tested & Compared

Plan de l'article

Tired of writing meeting minutes manually? 

AI minutes software is now a common tool to generate lighting-fast AI reports for each of your everyday meetings.

This article relies on a comparative study of the best AI meeting minutes software to help you make a choice. 

Methodology of the study : 

We compared the quality of the 6 best AI minutes software on the market (Fireflies, Otter.ai, TLDV, Sembly, MeetGeek, Noota). We gave them the same input document -which are mock YouTube Videos for 5 different types of meetings (Team Meeting, 1 on 1 Meeting, Job Interview, Annual General Meeting, Boad Meeting).

We used the built-in features of each software to generate AI notes for each meeting.

Here’s the workflow used for each software : 

  • Fireflies: we uploaded the audio and used the feature “customize” to apply the relevant built-in Fireflies “AI apps”.
  • MeetGeek: we used the “AI summary” section.
  • Sembly AI: we customized the AI notes based on the relevant built-in Sembly minutes template. 
  • Noota: we relied on the relevant built-in “AI summary templates” by using the “detailed” mode. 
  • TLDV: we used the relevant built-in “tag templates”. 
  • Otter AI: we copied the AI summary from the generic “summary” section. 

Then, we asked Claude Sonnet 3.5 to rank and compare the AI reports based on three criteria (Relevance, Precision, and Exhaustiveness).

To mitigate the influence of the order of submission of each minutes, we used a custom-made program that send to Sonnet 3.5 the same prompt but in random order. 

Here’s the prompt we used 20 times for each assessment : 

Here’s the transcription of the meeting : “ ”

Rank objectively by really comparing the relevance, precision and exhaustiveness of each minutes, give an order of quality from the best to the worst based on : how managers and team members can follow up on decisions, actions and discussions made during the meeting / based on how shareholders can be updated on the company situation and board members be oriented on the next steps / based on how coach can follow up on their sessions and give feedback to their coachees / based on how recruiters can review, compare and share candidate information from their interviews / based on how board members can follow up on their decisions and next steps : “*minutes given by random order*”

You can find the full benchmark here.

Here’s the overall ranking : 

  1. Noota: 558 points
  2. Fireflies: 416 points
  3. Sembly AI: 413 points
  4. MeetGeek: 395 points
  5. TLDV: 188 points
  6. OtterAI: 184 points

Points are calculated based on the addition of the score assigned to each ranking on the 20 repetitions of each test (1st : 6; 2nd : 5; 3d : 4; 4th : 3; 5th : 2; 6th : 1)

The study is based on the available capabilities of each tool in the 5 July 2024.

Rank Tool Team Meeting Job Interview 1-on-1 Meeting Annual General Meeting Board Meeting Total Points
1 Noota 106 113 101 120 118 558
2 Fireflies 68 99 78 73 98 416
3 Sembly AI 78 74 100 73 88 413
4 MeetGeek 89 72 74 84 76 395
5 TLDV 28 36 21 57 46 188
6 OtterAI 41 32 53 38 20 184

Overall Comparison made by Claude Sonnet 3,5 : 

  1. Noota consistently ranks as the top performer across different meeting types. Their minutes are:
    • Most comprehensive and well-structured
    • Provide clear overviews and detailed discussion points
    • Include specific, actionable items assigned to team members
    • Easy to follow and offer the most value for follow-up
    • Consistently provide clear sections for different parts of the meeting
  2. Fireflies generally ranks second or third. Their minutes:
    • Offer good structure with key objectives and blockers
    • Include unique features like speaker contributions
    • Provide chronological summaries with timestamps
    • Capture most key points and provide good context
    • However, they're usually less comprehensive than Noota's
  3. Sembly AI typically ranks second or third. Their minutes are:
    • Concise and well-organized
    • Include clear action items
    • Offer good outlines of main topics discussed
    • Provide a balance of summary and detail
    • However, they may lack some depth compared to Noota and Fireflies
  4. MeetGeek usually ranks in the middle. Their minutes:
    • Offer a good balance of summary and detail
    • Include AI insights on meeting efficiency
    • Provide timestamps and highlight key topics
    • Have clear formats with action items
    • However, they're often less detailed than the top performers
  5. TLDV typically ranks near the bottom. Their minutes:
    • Provide some key points and next steps
    • Include timestamps for reference
    • However, they lack the detail and structure needed for effective follow-up
    • Often miss important elements like clear action items
  6. Otter AI consistently ranks at the bottom. Their minutes:
    • Provide relevant information
    • However, they lack clear structure and specific action items
    • Are often the most difficult to follow and extract useful insights from

DETAILED RANKING 

Best AI Minutes Tools for Team Meetings

Product Marketing Meeting (weekly) 2021-06-28

Rank Tool Individual Run Rankings Total Points
1 Noota 2, 1, 1, 1, 1, 2, 1, 1, 2, 2, 2, 2, 1, 3, 2, 2, 1, 2, 1, 2 106
2 MeetGeek 1, 2, 3, 3, 2, 1, 4, 2, 3, 3, 1, 3, 2, 1, 4, 3, 2, 3, 2, 1 89
3 Sembly AI 4, 3, 4, 2, 4, 3, 2, 3, 1, 4, 3, 4, 4, 2, 3, 4, 3, 1, 5, 3 78
4 Fireflies 3, 5, 2, 4, 3, 4, 3, 4, 6, 4, 4, 1, 3, 4, 5, 1, 4, 5, 3, 4 68
5 OtterAI 5, 4, 5, 5, 6, 5, 5, 5, 4, 6, 5, 6, 5, 5, 1, 6, 5, 6, 4, 6 41
6 TLDV 6, 6, 6, 6, 5, 6, 6, 6, 5, 5, 6, 5, 6, 6, 6, 5, 6, 4, 6, 5 28

You can find the full comparison here.

Explanation given by Sonnet : 

Noota's minutes are the most comprehensive, well-structured, and actionable. They provide a clear overview, detailed discussion points, issues raised, and specific action items assigned to team members. The format is easy to follow and provides the most value for follow-up. 

MeetGeek's minutes offer a good balance of summary and detail. They include AI insights on meeting efficiency, highlight key topics, and provide timestamps. The format is clear and includes action items, though not as specific as Noota's. 

Sembly AI's minutes are concise and well-organized with clear action items. However, they lack some of the depth and context provided by the top two. 

Fireflies' minutes have a good structure with key objectives, blockers, and action items. They also include speaker contributions, which is unique. However, they're less comprehensive than the top three. 

OtterAI's minutes provide a decent overview but lack clear structure and specific action items. The information is there, but it's not as easy to follow up on decisions and actions. TLDV's minutes are the least comprehensive and actionable. While they provide some key points and next steps, they lack the detail and structure needed for effective follow-up.

Best AI Minutes Tools for Job Interviews

Rank Tool Individual Run Rankings Total Points
1 Noota 1, 2, 1, 2, 1, 1, 1, 2, 1, 3, 1, 1, 4, 1, 1, 1, 3, 2, 1, 1 113
2 Fireflies 2, 1, 2, 1, 2, 3, 3, 1, 2, 1, 2, 2, 1, 3, 2, 2, 1, 1, 2, 2 99
3 Sembly AI 3, 4, 3, 4, 4, 2, 4, 4, 3, 4, 3, 3, 2, 5, 3, 4, 2, 4, 4, 3 74
4 Meet Geek 4, 3, 4, 3, 3, 4, 5, 3, 4, 2, 4, 4, 3, 4, 5, 5, 4, 3, 5, 4 72
5 TLDV 5, 5, 5, 6, 5, 5, 6, 5, 5, 5, 5, 5, 5, 6, 4, 3, 6, 5, 6, 5 36
6 Otter AI 6, 6, 6, 5, 6, 6, 2, 6, 6, 6, 6, 6, 6, 2, 6, 6, 5, 6, 3, 6 32

You can find the full comparison here.

Explanation given by Sonnet : 

Noota's minutes are the most comprehensive and well-structured. They provide a detailed overview of the candidate's background, motivations, skills, and potential concerns. The information is organized into clear sections, making it easy for recruiters to find specific details. 

Fireflies offers a detailed, chronological summary of the interview with timestamps. It captures most of the key points and provides good context for each topic discussed. 

Sembly AI provides a concise summary and a well-organized outline of the main topics discussed. While not as detailed as Noota or Fireflies, it offers a good overview of the candidate's qualifications and interests. 

Meet Geek's minutes include some useful insights and KPI scores, which could be helpful for recruiters. However, the organization is less clear, and some important details are missing. 

TLDV's minutes are brief and provide a basic outline of the interview. While it captures some key points, it lacks the depth and detail that recruiters might need for a thorough evaluation. 

Otter AI's minutes are the least structured and most difficult to follow. While they contain some relevant information, the lack of organization and context makes it challenging for recruiters to extract useful insights efficiently.

Best AI Minutes Tools for 1 on 1 

Rank Tool Individual Run Rankings Total Points
1 Noota 1, 1, 1, 1, 4, 1, 2, 4, 1, 1, 1, 1, 4, 5, 3, 1, 1, 2, 3, 1 101
2 Sembly AI 2, 2, 2, 2, 1, 4, 1, 1, 2, 2, 5, 3, 3, 1, 1, 2, 2, 1, 2, 3 100
3 Fireflies 3, 3, 3, 3, 2, 2, 3, 2, 3, 4, 4, 2, 2, 2, 5, 3, 3, 4, 4, 2 78
4 Meet Geek 4, 4, 4, 4, 3, 3, 4, 3, 4, 3, 3, 5, 1, 3, 2, 4, 4, 3, 1, 4 74
5 Otter AI 5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 2, 4, 5, 4, 4, 5, 5, 5, 5, 5 53
6 TLDV 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 21

You can find the full comparison here.

Explanation given by Sonnet : 

Noota's minutes are the most comprehensive, structured, and relevant to the coaching session. They provide a clear overview, detailed action items, and insights into the coachee's challenges and goals. The format is easy to follow and would be highly useful for coach follow-up. 

Sembly AI's minutes offer a well-structured summary with a detailed outline of the session. They capture key discussion points and insights, making it easy for the coach to review and follow up on important topics.

Fireflies' minutes provide a good overview with timestamps and action items. While not as detailed as the top two, they still offer valuable information for coach follow-up. 

Meet Geek's minutes have a good structure with topics and highlights, but lack some of the depth and specificity found in the top-ranked minutes.

Otter AI's minutes are less structured and more difficult to follow. While they contain relevant information, the format is not as conducive to easy coach follow-up.

TLDV's minutes are the least relevant and seem to be about a different meeting altogether. They do not accurately reflect the coaching session discussed in the transcript and would not be useful for coach follow-up in this context.

Best AI Minutes Tools for Annual General Meeting

Rank Tool Individual Run Rankings Total Points
1 Noota 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 120
2 MeetGeek 2, 2, 3, 3, 3, 3, 4, 2, 6, 2, 2, 3, 2, 3, 2, 3, 2, 2, 5, 5 84
3 Sembly AI 4, 5, 4, 2, 4, 4, 6, 3, 2, 6, 3, 2, 3, 4, 3, 2, 3, 3, 4, 3 73
4 Fireflies 6, 3, 2, 4, 2, 2, 3, 5, 4, 3, 4, 4, 5, 2, 6, 4, 6, 6, 3, 4 73
5 TLDV 3, 6, 5, 5, 5, 6, 2, 6, 3, 4, 5, 5, 4, 5, 4, 5, 4, 4, 2, 2 57
6 Otter AI 5, 4, 6, 6, 6, 5, 5, 4, 5, 5, 6, 6, 6, 6, 5, 6, 5, 6, 4, 6 38

You can find the full comparison here.

Explanation given by Sonnet : 

Noota's minutes are the most comprehensive, detailed and well-structured. They provide an excellent overview of all key aspects of the meeting, including financial results, board activities, governance changes, and future plans. The format with clear sections like "Chairperson's Report", "Financial Report", "Committee Reports" etc. makes it easy to find specific information. The "Next Steps" section is particularly useful for orienting board members. 

MeetGeek's minutes offer a good balance of summary and detail. The "Topics & Highlights" section provides a quick overview, while the "Next Steps" section clearly outlines future actions. 

The "AI Insights" add an interesting analytical layer, though they may not be essential for all readers. Sembly AI's minutes have a nice structure with highlights, key updates, and future projections clearly separated. The information is concise yet comprehensive. However, they lack some of the detail found in the top two.

Fireflies' minutes provide a good summary and highlight key decisions and action items. However, they are less comprehensive than the top three and the structure is not as clear. 

TLDV's minutes offer some good insights and timestamps, but the structure is less clear and the coverage less comprehensive than the top options. The lack of a clear "next steps" or action items section is a notable omission. 

Otter AI's minutes, while containing relevant information, are the least structured and hardest to navigate. The outline format makes it difficult to quickly grasp the key points and next steps.

Best AI Minutes Tools for Board Meetings

Rank Tool Individual Run Rankings Total Points
1 Noota 1, 1, 1, 1, 1, 1, 1, 2, 1, 2, 1, 2, 1, 1, 2, 1, 1, 1, 1, 1 118
2 Fireflies 2, 3, 2, 2, 2, 2, 2, 1, 2, 1, 3, 1, 2, 3, 1, 2, 3, 4, 2, 4 98
3 Sembly AI 3, 4, 4, 4, 4, 4, 5, 3, 4, 4, 4, 4, 4, 2, 3, 4, 4, 2, 5, 3 88
4 MeetGeek 4, 2, 3, 3, 3, 3, 4, 4, 3, 3, 2, 3, 3, 4, 5, 3, 2, 5, 3, 3 76
5 TLDV 5, 5, 5, 5, 5, 5, 3, 5, 5, 5, 5, 5, 5, 4, 4, 5, 5, 3, 4, 5 46
6 OtterAI 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 20

You can find the full comparison here.

Explanation given by Sonnet : 

Noota's minutes are the most comprehensive and well-structured. They provide a clear outline of the meeting, including attendance, approval of previous minutes, detailed reports from various executives, and specific action items with assigned responsibilities. This format allows for easy follow-up on decisions and next steps. 

Fireflies' minutes are also well-organized and provide a good summary of key discussions and decisions. They include specific financial figures and strategic points, which are useful for board members. However, they lack some of the detail and clear action items present in Noota's minutes. 

Sembly AI's minutes offer a good outline of the meeting topics and some key points discussed. They provide timestamps, which can be helpful for reference. However, they lack the detail of the top two and don't clearly state decisions made or action items. 

MeetGeek's minutes provide a concise summary of the main topics discussed but lack the detail and structure of the top-ranked minutes. They don't clearly outline decisions or action items for follow-up. 

TLDV's minutes offer some good information with timestamps but are less structured and comprehensive than the higher-ranked options. They don't clearly state decisions or action items. 

OtterAI's minutes are the least useful for board members to follow up on decisions and next steps. They provide some information but lack structure, detail, and clear action items. The inclusion of a template at the beginning is confusing and takes up space without adding value.

Related Articles

Interview Shadowing : Everything You Need to Know

Do you wonder what shadow interviewing is and how to conduct it the right way ? Check this guide.

Read more
Interviewer Training : a Starter Guide

Do you want to make sure to coach your hiring managers and recruiters the right way for their interviews ? Check this out.

Read more
What are Interview Metrics and How to Track Them ?

You want to know which KPIs to rely on to assess your interview quality, performance and accuracy ? Here's everything you need to know.

Read more

Use Noota Al to boost your productivity now

You are 4 minutes away from creating amazing
Al meeting notes.

Try 14 days for free
Try for free
You are in good company

Forget note-taking and save time in your meetings now!