Open Systems Technologies Corporation is looking for a Data Engineers to join our Advana team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our Advana data infrastructure and systems. Your expertise in ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks will be essential in ensuring efficient data processing and analysis.

Responsibilities

• Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
• Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing.
• Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets.
• Leverage big data technologies to efficiently process and analyze large datasets, particularly those encountered in a federal agency.
• Troubleshoot data-related problems and provide innovative solutions to address complex data challenges.
• Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices.
• Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures.
• Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes.
• Maintain documentation for software applications, workflows, and processes.
• Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement.

  Required Skills:

• Clearance: Secret clearance is required
• Minimum of 5 years of experience as a Data Engineer, with demonstrated experience creating data pipelines from scratch.
• High level of proficiency in ETL processes and demonstrated, hands-on experience with technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
• Must have strong experience with Databricks.
• Strong problem-solving skills and ability to solve complex data-related issues.
• Demonstrated experience working with large datasets and leveraging big data technologies to process and analyze data efficiently.
• Understanding of data modeling/visualization, database design principles, and data governance practices.
• Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
• Detail-oriented mindset with a commitment to delivering high-quality results.
• Must be in the DC Metro area and available to work onsite (Crystal City, VA and Alexandria, VA) 3 days per week.

Preferred Skills:

• Knowledge of Qlik/Qlik Sense, QVD/QlikView, and Qlik Production Application Standards (QPAS) is a significant plus.
• Recent DoD or IC-related experience.
• Previous experience with Advana is a plus.

  
  

  BENEFITS

  Our company OST has been operating since 1996 and have various contracts with Government agencies. We offer a comprehensive benefit package that includes 3 weeks paid time off, 11 Paid Holidays, medical/dental coverage, STD, LTD, Life Insurance, AD&D, 401k with up to 4% match, and end of year profit sharing paid out in 401k.

  PDN-9d082469-f342-4757-b91f-7657c479f071