Data Engineer

Location: Newport News, Virginia
Date Posted: 06-29-2018
Client: Fortune 500 Company
Role: Data Engineer
Location: Newport News, VA
As a Data Engineer you will be responsible for developing a new data engineering platform that leverages the Azure cloud architecture. Integrating native Azure services and customized data technologies. Experience and understanding of considerations for architecting, solutioning and operationalization of data warehouses, data lakes and analytics platforms on Azure is a must. We are looking for candidates who have a broad set of technology skills across these areas and who can demonstrate an ability to design right solutions with the appropriate combination of Azure and custom technologies for deploying on the cloud.  
You will be part of a team building the new data platform to assist in solving the businesses need for more rapid delivery of data. You will be responsible for designing and implementing the complex ETL pipelines in the Azure data platform and other solutions to support our business partners demand for data and use it to deliver the data as service to support day-to-day decision making.
  • Interfacing with business customers, gathering requirements and developing new datasets in data platform
  • Building and migrating the complex ETL pipelines from on premise system to cloud and Hadoop/Spark to make the system grow elastically
  • Identifying the data quality issues to address them immediately to provide great user experience
  • Extracting and combining data from various heterogeneous data sources
  • Designing, implementing and supporting a platform that can provide ad-hoc access to large datasets
  • Modeling data and metadata to support machine learning and AI 
Basic Qualifications:
  • Bachelors or master’s in computer science, Engineering, Mathematics, Statistics, or related field
  • 2+ years relevant experience in cloud-based engineering.
  • 4+ years of Microsoft Database Development / Business Intelligence experience
  • Demonstrated ability in data modeling, ETL development, and data warehousing.
  • Data Warehousing Experience with SQL Server, Oracle, Redshift, Teradata, etc.
  • Experience with Big Data Technologies (NoSQL databases, Hadoop, Hive, Hbase, Pig, Spark, Elasticsearch etc.)
  • Experience in using Python, Java and/or other data engineering languages
  • Knowledge and experience of SQL and SSIS.
  • Excellent communication, analytical and collaborative problem-solving skills
  • Demonstrated ability to work effectively as part of a team
this job portal is powered by CATS