Internet of Things
2019Python · pandas · OpenCV · face_recognition · Boto3
Data Engineer
2019.06 → presentInnoscape // massive open-data extraction · RetailTech market intelligence
01Design, build and operate the large-scale web data collection: scrapers and crawlers across competitor e-commerce sites in the DIY & home-improvement retail sector, in France and internationally — reverse-engineering evolving anti-bot and CAPTCHA protections, and keeping everything running as target sites change.
02Build automation robots that drive partner platforms end to end — authenticated sessions, navigation, data retrieval — then clean, transform and load the results into the pipeline.
03Own the Linux server fleet on AWS EC2 and on-premise: provisioning, configuration, scheduling, monitoring and maintenance of the collection and processing jobs running across dozens of projects.
04Own database administration end to end across MySQL and AWS RDS — data modelling and schema design, indexing and query performance, users and privileges, retention, archiving, automated backups and recovery, and version upgrades.
05Own the analytics-facing data layer: model and deliver the datasets the BI team builds its reporting on, and run validation checks that catch data-quality problems before they reach the business.
06Led the migration of the legacy Hadoop / Spark / Scala platform — previously orchestrated and monitored through Kylo — to Microsoft Fabric: porting and re-engineering existing jobs as Fabric notebooks, moving data from S3 into the Lakehouse, and architecting the new pipelines from scratch.
07Run internal technical sessions for the wider team, sharing working knowledge of new tools and fields — machine learning and AI, security, and data-platform practice.