LatentView is looking for Data Engineer to join our growing team of technical experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection. The ideal candidate should have strong experience in handling, processing, and analysing huge sets of data. The right candidate will be excited by the prospect of optimizing or even re-designing our data architecture to support our client’s future data platform built on cloud-based ecosystem.
- Python (command line and REST API)
- SQL (hive, spark sql)
- Over 5 – 8 years of hands on experience working on AWS, Python and distributed systems.
- Experience in distributed systems Spark, hive Etc
- Good exposure in SQL, no SQL,
- Experience in CI/CD frameworks – Jenkins, code build, Git
- Proficiency in programming Python
- Experience on Scala