Job & Location
Mercaux has an international team in four offices – London, Barcelona, Milan and Moscow. We are looking for Data Engineer in Moscow with optional relocation to Barcelona.
Company & Product
Mercaux is an in-store B2B SaaS Platform that aims to transform offline retail and help traditional retailers smoothly transition into digital era. Founded by ex-Yandex tech team and Harvard Business School alumni, Mercaux products are live in 30 countries including UK, Europe, Hong Kong, Brazil, and Mexico.
We bring digital into physical stores to empower sales people with all the data and content at fingertips, connect head office with stores real-time, and help retailers provide unique in-store customer experience. First retailers who adopted the software have seen +8-14% store sales increase.
Challenges
- Development of a DataLake cluster in AWS
- New data sources analysis and integration
- Data quality monitoring automatisation
- ETL processes optimisation
Expected experience
- Python3, SQLAlchemy, pandas, requests - over 2 years
- Relational database experience, PostgreSQL
- SQL (joins, window functions, aggregations)
- GIT and source control management experience
- Confidence using unix shell
- Hadoop experience (YARN, HDFS)
- Apache Spark experience
- ETL processes development
- English: intermediate and higher
Also nice to have
- Understanding of internal relational databases processes (indexes, temporary tables, transactions, isolation levels, MVCC)
- Knowledge of network interfaces and protocols (client-server, HTTP, SOAP, SSH)
- AWS experience
- Docker
- Scala
- Oozie
- Other MapReduce systems
- ML experience
Current technology stack
Python3, PostgreSQL, SQLAlchemy, Pandas, Celery, AWS (S3, RDS, SQS)
New stack, currently migrating
Python3, Hive, Spark, Oozie, AWS (S3, EMR)