Season 1, Episode 2: The BIG lie

Cover Image for Season 1, Episode 2: The BIG lie

It started this day

In early 2023, Sacha, then CTO of Le Monde, France's leading news outlet with 300 millions page views and 46 millions of users monthly, faced a critical issue. Despite his pursuit of perfection, he noticed discrepancies in core metrics reported in corporate dashboards, weekly activity reports, and monthly management reports.

Key indicators such as Monthly Active Users (MAU), Daily Active Users (DAU), sessions, page views, and retention rates were consistently inaccurate, often understated by a significant double-digit percentage. The analytics tools, costing Le Monde hundreds of thousands of dollars annually, were failing to provide precise data.

Gilles, CEO of Letsmeet, a productivity software company, encountered a similar problem. An A/B test showed a 17% improvement with solution B after two months, but once deployed to all users, the improvement dropped to 2%. Investigation revealed that 30% of Letsmeet users, including 70% of core users, were not tracked by the analytics tools.

Each in their separate ways, Sacha and Gilles discussed their concerns with industry peers across media, ecommerce, entertainment, and productivity sectors in both France and the US. They discovered a widespread issue: a conservative estimate showed that a quarter of users, representing a third of usage, were missing from all analytics tools.

These digital companies relied heavily on data for strategic decisions. Detailed dashboards on retention, customer lifetime, and cohort behavior were standard. A/B testing and conversion funnel analysis drove product decisions. Some even used AI to model user behavior. Despite the inaccuracies, management had no choice but to proceed as if the data were correct, lacking any viable alternative.

Only for the tech girls and boys 🤠, here's a snapshot of our achievements thus far.

  • Bye-bye SDKs, welcome Components: Edgee is embracing WebAssembly (Wasm) Components model to revolutionize web SDKs. Transitioning from traditional JavaScript and mobile SDKs to Wasm components, we're set to run everything efficiently at the edge for faster, more scalable applications.
  • Security: Our platform is engineered with top-tier security. Upon release, Edgee will offer robust protection for websites and apps. In the coming weeks, look forward to enhanced security layers developed in collaboration with our partners, utilizing Wasm components.
  • Documentation: Great documentation is crucial for dev tools. At Edgee, we're committed to providing comprehensive and clear documentation. Our guides will cover all features and concepts, helping developers maximize the benefits of Edgee's edge computing capabilities.

What will happen on the Episode 3?

In the next episode, we will answer to this fundamental question : Why are the analytics data so consistently inaccurate?