About Latentview:
- LatentView Analytics is a leading global analytics and decision sciences provider, delivering solutions that help companies drive digital transformation and use data to gain a competitive advantage. With analytics solutions that provide 360-degree view of the digital consumer, fuel machine learning capabilities and support artificial intelligence initiatives., LatentView Analytics enables leading global brands to predict new revenue streams, anticipate product trends and popularity, improve customer retention rates, optimize investment decisions and turn unstructured data into a valuable business asset.
- We specialize in Predictive Modelling, Marketing Analytics, Big Data Analytics, Advanced Analytics, Web Analytics, Data Science, Data Engineering, Artificial Intelligence and Machine Learning Applications.
- LatentView Analytics is a trusted partner to enterprises worldwide, including more than two dozen Fortune 500 companies in the retail, CPG, financial, technology and healthcare sectors
Job Description
Total Experience: 2.5 to 6years
Location: Chennai/Bangalore
- Data Migration Planning: Collaborate with the data & client teams to understand the data schema, requirements, and business logic used in source systems. Develop a comprehensive data migration plan using FiveTran and DBT to replicate and transform data in Snowflake.
- FiveTran Integration: Configure and manage FiveTran connectors to extract data from various source systems. Ensure reliability and completeness of data extraction and loading processes.
- Snowflake Data Warehouse: Set up and optimize the Snowflake data warehouse environment, including schema design, resource utilization, and security considerations.
- Data Transformation with DBT: Utilize DBT (Data Build Tool) to transform the data from the source schema to the desired target schema in Snowflake. Create DBT models to manage data transformation logic efficiently.
- Performance Optimization & Quality Assurance: Monitor and optimize data pipeline performance, data loading speed, and query execution times in Snowflake. Identify and address bottlenecks in the migration process. Implement data validation and data quality checks to ensure the accuracy and consistency of migrated data in Snowflake.
- Error Handling and Troubleshooting: Develop error-handling mechanisms and implement appropriate solutions to address any data migration issues or discrepancies.
- Documentation: Maintain clear and comprehensive documentation of the data migration process, including configuration settings, data mappings, transformation logic, and tuning.
- Governance & Security: Implement data security measures and comply with data governance policies throughout the migration process, ensuring data privacy and protection.
Requirements:
- Expertise in data engineering landscape especially & experience in migration projects.
- Experience with source systems like AWS, Oracle & Hands-on knowledge in building data pipelines from ingestion, integration to transformation using Snowflake, DBT, FiveTran
- Deep knowledge of modern data engineering concepts, ETL/ELT paradigms
- Familiarity with other data integration, pipeline orchestration, version control systems and transformation tools is an advantage.
- Certification in AWS, Snowflake, or DBT is a plus.
- Knowledge of trends in fast-moving data technologies landscape along with some understanding (Data mesh, Streaming architecture, multi-cloud data platforms, Graph DB, Immuta, etc.)
- Strong problem-solving skills & analytical skills with the ability to collect, organize, analyse, and disseminate significant amounts of information with attention to detail and accuracy
- Ability to work with distributed teams & engage with senior business leaders in a collaborative manner (onsite and offshore)
Experience in working for Analytics or IT Consulting Services company in a global delivery model will be a plus