Data Engineer

Job & Location 

Mercaux has an international team in four offices – London, Barcelona, Milan and Moscow. We are looking for Data Engineer in Moscow with optional relocation to Barcelona.

Company & Product 

Mercaux is an in-store B2B SaaS Platform that aims to transform offline retail and help traditional retailers smoothly transition into digital era. Founded by ex-Yandex tech team and Harvard Business School alumni, Mercaux products are live in 30 countries including UK, Europe, Hong Kong, Brazil, and Mexico.

We bring digital into physical stores to empower sales people with all the data and content at fingertips, connect head office with stores real-time, and help retailers provide unique in-store customer experience. First retailers who adopted the software have seen +8-14% store sales increase.

Challenges

  • Development of a DataLake cluster in AWS
  • New data sources analysis and integration
  • Data quality monitoring automatisation
  • ETL processes optimisation

Expected experience

  • Python3, SQLAlchemy, pandas, requests - over 2 years
  • Relational database experience, PostgreSQL
  • SQL (joins, window functions, aggregations)
  • GIT and source control management experience
  • Confidence using unix shell
  • Hadoop experience (YARN, HDFS)
  • Apache Spark experience
  • ETL processes development
  • English: intermediate and higher

Also nice to have

  • Understanding of internal relational databases processes (indexes, temporary tables, transactions, isolation levels, MVCC)
  • Knowledge of network interfaces and protocols (client-server, HTTP, SOAP, SSH)
  • AWS experience
  • Docker
  • Scala
  • Oozie
  • Other MapReduce systems
  • ML experience

Current technology stack
Python3, PostgreSQL, SQLAlchemy, Pandas, Celery, AWS (S3, RDS, SQS)

New stack, currently migrating
Python3, Hive, Spark, Oozie, AWS (S3, EMR)

Want to apply later?

Type your email address below to receive a reminder

Apply to Job

ErrorRequired field
ErrorRequired field
ErrorRequired field
Error
insert_drive_file