Where retail product master data was once gathered manually in physical stores, Daltix’s product data aggregation platform blends multiple datasets to give its clients up-to-date regional and competitor insights through a single dashboard. Simon Esprit, Partner, CTO at Daltix, explained to us how it works using Snowflake’s Data Cloud.
In the highly competitive retail world where brands are constantly fighting for customer loyalty, getting products right—across everything from price and promotions to unit size and nutritional information—can be critical to success. And it’s not just retailers that need to keep a close eye on industry data. Increasingly, fast-moving consumer goods (FMCG) manufacturers and even market research agencies need up-to-date product master data at their fingertips to ensure customers get exactly what they want.
That’s where Daltix comes in. Its technologies actively scrape a wide range of product data from across brands’ websites. This information is then blended with trusted third-party data—and even field data—to help its clients more accurately strategize product pricing and positioning against their competitors and the wider market across multiple locations.
“From pricing data to promotions, customers need quality data to track the retail market,” said Simon Esprit, Partner, CTO at Daltix. “Historically, this data was collected manually by teams visiting stores and recording pricing data. It’s costly, slow, and risks human error, making it inaccurate. We wanted to offer high-quality retail data online that’s updated daily, unburdened by the risk of human error.”
Keen to disrupt and lead the e-commerce pricing market in Benelux, Daltix started with a simple PostgreSQL database. But as the company’s platform was scraping an increasing amount of data each day, Esprit and his team found it difficult to access data for different retailers. In addition, Daltix found it difficult to scale its workloads cost-effectively, access data for new use cases, change how it stored data, and maintain sufficient data analytics performance.
“After talking to various consultants, we built a data lake on AWS, but this proved costly and far too complex for our non-data engineering teams,” explained Esprit. “We also tried Amazon Redshift, but again, we needed something easier to use. Luckily, one of our data engineers suggested Snowflake’s Data Cloud. From day one it was far easier to scale and use, and had better data sharing capabilities while being secure. And unlike Redshift, Snowflake’s platform supports JSON data—making running queries far easier.”
An elastic single source of truth for data
With nearly 60TB of data stored across Snowflake’s platform, processing more than 10GB each day, Daltix’s data engineers and data scientists have noticed significant performance and efficiency improvements. In particular, the company’s analytics team no longer needs to manually clean its ingested data, instead, they use the automated data cleansing capabilities in Snowflake to maintain high-quality data quicker than ever before.
Esprit and his team also take advantage of nuanced data processing capabilities of Snowflake’s platform to reduce the risk of errors and enable them to experiment more with their datasets—which ultimately benefits their clients. “We use Time Travel to avoid making undetectable mistakes, which allows us to be more flexible, experiment more, and move faster,” explained Esprit. “We also use Zero-Copy Cloning to carry out fast testing without manipulating live databases. It gives us easy access to tables across our databases and allows us to share data with our clients for proof of concepts.”
Intelligent data processing for faster insights at scale
A large part of Daltix’s work involves using machine learning on a vast scale. Using Snowflake Data Cloud’s integrations with other third-party vendors, Daltix can now augment its datasets with sophisticated machine learning algorithms. This means its teams no longer have to manually sift through the company’s data lake to train models.
“Snowflake’s Data Cloud makes it so easy to send data between environments for machine learning purposes,” said Esprit. “It means our data is higher quality and more comparable across retailers. The platform also significantly reduces the manual data manipulation required to standardize categories and EANs across products. It even allows us to check the data quality and maintain complete control over it.”
What’s more, Daltix has also integrated its Data Cloud environment with Looker to match its dashboards and web application.
Cost efficiency and performance in one solution
Since using Snowflake’s Data Cloud, Daltix’s analysts have doubled their productivity, boosting the team’s morale. And with no infrastructure to manage, the company has also avoided hiring unnecessary additional data engineers.
The way Daltix stores and processes its clients’ data is somewhat unique to the market, using the scale of Snowflake’s platform as an advantage over other players in the industry. Esprit explained: “Each of our clients benefits from their own isolated data warehouse in Snowflake. It gives us the flexibility to scale individual clients’ environments and create new ones with a single SQL command. The upshot is we can individualize costs per client with far greater oversight. And thanks to auto-suspend, we don’t pay for idle warehouses—cutting costs by half per customer versus an always-on solution. There’s also no maintenance on our end, which saves significant resources.”
Daltix’s clients are already feeling the performance benefits with faster response times and greater analytics team productivity, which translate to better quality insights.
For example, the company’s work with FMCG behemoth Unilever has helped the conglomerate achieve faster analysis for its go-to-market strategies. Using Daltix’s platform, Unilever can now track multiple data fields—such as product names and EANs—to bridge the gap between a new product being launched in stores and Unilever receiving critical performance insights.
Ambitious growth plans supported by near-limitless scalability
Spurred by the success its clients have already achieved using its platform’s data, Daltix is expanding its reach throughout Germany, with the view to enter other European markets in future. The company is also exploring giving all its customers access to their data in Snowflake’s Data Cloud, using an API to provide more up-to-date data—faster.
“We’re scaling our operations to new markets safe in the knowledge Snowflake has the ecosystem for future expansion,” said Esprit. “And while Snowflake was new to most of our data engineers, they all love using it. It’s removed a lot of manual data querying from their roles and everyone is happy. We can certainly forget about looking at other data cloud options—Snowflake has it all covered.”