We are seeking a Data Engineer with a passion for learning and problem-solving to join our team. The ideal candidate will be responsible for designing and implementing data migration processes, integrating data from various sources, and ensuring the secure and efficient handling of both structured and unstructured data. Proficiency with Azure Data Factory, Qlik Replicate, and cloud platforms such as Azure and AWS is highly desirable. The successful candidate will play a key role in optimizing and securing our data migration and integration workflows. You Will:
- Collaborate with data architects and project managers to develop comprehensive data migration strategies for structured (e.g., relational databases) and unstructured data (e.g., documents, media).
- Use Qlik Replicate for real-time replication, Change Data Capture (CDC), and data migration from source databases to target environments.
- Ensure data integration across diverse sources (on-premises, cloud, ADLS, databases) into platforms like Azure, AWS, and Microsoft Dataverse.
- Automate tasks such as data validation, transformation, and reconciliation to ensure efficiency and consistency.
- Perform data profiling, cleansing, and transformation to support accurate mapping and merging of data formats.
- Conduct thorough testing (unit, integration, performance) and ensure the accuracy and completeness of migrated data.
- Troubleshoot data migration issues, optimize performance, and provide post-migration support.
- Create and maintain documentation for ETL workflows, data migration scripts, and configuration settings.
- Collaborate closely with stakeholders to provide status updates and resolve data-related challenges.
- Stay current with the latest data engineering tools, technologies, and best practices.
- Refactor current application's Microsoft Dataverse database schema to comply with business logic rules and enhance database performance.
You Have:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Proficient and experience with Microsoft Dynamics and integrating data into Microsoft Dataverse, interacting with tables, logic and validation, security, and developer capabilities.
- Experience with Azure services such as Azure Data Lake Storage (ADLS), Azure SQL Database, Synapse Analytics, and Event Hub for end-to-end data flow.
- Strong knowledge of data governance, security and compliance within Azure (RBAC, managed identities, and data encryption).
- Hands on experience with designing, developing, and maintaining data pipelines using Azure Data Factory, synapse pipelines, or similar orchestration.
- Experience with cloud-based data lake platforms such as Amazon S3, Databricks, and Snowflake
- 5+ years of experience in data engineering, specifically with data migration and integration projects.
- Proficiency in working with both structured (relational databases, data warehouses) and unstructured data (files, NoSQL, media).
- Experience with cloud platforms such as Azure and AWS for data migration and storage.
- Strong understanding of data modeling, data architecture, and data governance principles.
- Familiarity with SQL and NoSQL databases, as well as experience with large-scale data integration projects.
- Strong analytical, problem-solving, and debugging skills.
- Excellent verbal and written communication skills for collaboration across teams.
- Ability to work independently and manage multiple priorities in a fast-paced environment.
This position offers a unique opportunity to contribute to cutting-edge data migration and integration projects while optimizing the performance and security of our data workflows. If you are passionate about data engineering and have the required skills and experience, we encourage you to apply. Want to hear more? Read on to see what our Team Members say about their experience:
"From day 1, I knew Atlas Tech was where I wanted to be. Atlas' culture embraces creativeness, community involvement, and taking care of their employees. If you're looking for a great place to work, come join us!" - Blane
"I could not have asked for a better company to transition from Active-Duty military to civilian life. Atlas not only provides opportunities for professional growth, but it's also highly encouraged. The passion and appreciation for what we do that is displayed every day, makes it exciting for me to come to work each day." - Laurence Atlas Tech is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, sexual orientation, gender identity, national origin, disability, genetic information, or protected veteran status. We are committed to fostering an inclusive workplace where diverse perspectives are valued and respected. Accessibility & Accommodations
Atlas Tech strives to make our website, www.atlas-tech.com, accessible to all users. If you need assistance completing the application process or require a reasonable accommodation due to a disability, please contact us at hr.recruiter@atlas-tech.com. This contact information is designated for accommodation requests only and cannot be used to inquire about the status of an application. Atlas Tech is committed to providing reasonable accommodations in accordance with the Americans with Disabilities Act (ADA). Atlas Tech offers a competitive salary, generous benefits package, and an opportunity to make a positive impact in your own community.
|