Review of BVI charter planning blog post (by Claude Sonnet 5)

  • Clean paragraphs of content
  • Exaggerated a bit but almost all information was true
  • Created some new details about the BVI that I didn’t know about - werent in my notes but solid additions
  • Captured some of the most interesting points and framed them well
  • Did not use any sensitive information (names, dates, home airport)

Review of BVI charter planning blog post (by qwen 3 14b)

  • A model this size struggles with maintaining context from multiple documents, missing details that are helpful to include
  • Completely fabricates details and an itinerary
  • Using a bunch of emojis - think Claude avoids as its a pattern seen as an indicator of using AI
  • Overused names and made up stories about who is involved
  • Mis-quoted the amount of months and misunderstood the math around flights and total budget
  • Reads more like an advertisement than a blog post
  • Quotes exact dates - something I wouldn’t want to share publicly before the trip

Review of BVI charter planning blog post (by qwen 3 14b 8k context)

  • This shows that the real issue was the context window with the first one
  • A lot less fabrication, still spots of it though
  • Did not change the protection of sensitive information (people’s names, exact dates)