Data Engineer

Remote (ALL US) Data Driven Enterprise - Data Driven Enterprise Full Time

The Data Engineer will engage in high-value data driven solutions leveraging Valorem Reply’s proven implementation methodology and solutions for enterprise projects. You will work with a team of consultants through the design, development and enhancement of Data and Advanced Analytics solutions, both as independent projects and as part of cross functional teams. As part of the Data Driven Enterprise service line, the Data Engineer will collaborate with Architects, Project Managers and leads to ensure optimized delivery of solutions. The successful candidate will have a strong technical background as well as extensive experience working on large, complex, and highly technical projects.
 
This position will represent Valorem Reply’s approach to advanced data engineering solutions and as such must demonstrate proficiency in one or more of the specific solution areas. This position will implement the Data Lakehouse solution through people, process, and technology.  This is a hands-on role leading, coding, and delivering on the most advanced cloud data analytics platforms available. Projects span from workshops to full enterprise production end to end solutions.
 
The ideal candidate will have extensive experience building data solutions on Azure using Databricks. Proficiency with the Databricks platform, implementing enterprise Data Lakehouse is preferred.  Candidates will be expected to contribute to all stages of the data lifecycle including data ingestion, data modeling, data profiling, data quality, data transformation, data movement, and data curation.
 
Candidate should be familiar with the market challenges in multiple industry verticals and have experience with both traditional and modern across the Microsoft technology stack. 

Requirements

  • Focus on Azure data engineering solutions
  • 6+ years data engineering delivery experience
  • 2+ years of Databricks engineering development experience
  • 2+ years technical team leadership or technical management experience
  • Strong collaboration skills, embraces change, works well with ambiguity, shifts easily across roles and groups.
  • Ability and willingness to take the initiative to serve the client needs first.
  • Ability to engage directly with the client stakeholder, managers, and end users.
  • Ability to interface with clients up to the C-suite, down to the line worker.
  • Ability to design and implement Advanced Analytics solutions based on customer needs and knowledge of Microsoft Cloud and related Open-Source (Apache) technologies
  • Ability to triage and self-direct, prioritize and manage time effectively.
  • Ability to collaborate with other members of the Valorem Reply team, including Project Managers, Software Engineers, and Business Analysts
  • Technical Skills Required

  • General Architecture
  • ·         Implement data warehouse solutions
  • ·         Understand pipeline/process-based systems
  • ·         Experience with pipeline automation
  • ·         Experience solutioning Azure Cloud based enterprise data architectures.
  • Information Architecture
  • ·         Data Modeling principles for relational and dimensional data structures
  • ·         Data Warehouse design principles
  • ·         Data Lake design principles, Data Virtualization
  • ·         Hybrid enterprise data architecture
  • Microsoft Azure Stack
  • ·         RDBMS: Azure SQL / SQL Server 2016+ (SQL, Structure, Stored Procs, Tuning)
  • ·         ETL/ELT, (ADF, SSIS)
  • ·         Analysis Services [Tabular]
  • ·         Databricks Delta Lake Storage
  • - Azure Dev OPS
  • Desired Skills

  • Advanced Analytics Data Technologies
  • ·         Databricks, Delta Lake, Synapse
  • ·         Spark SQL, Pyspark
  • ·         Azure Data Explorer
  • ·         Logic Apps, Key Vault
  • ·         Semi structured data processing
  • ·         Integration Runtime
  • Information Architecture
  • ·         Data Stewardship, Ownership and Quality Management principles
  • - Data Governance, Data Catalog, Enterprise Information Management
  • Non-Technical Skills

  • Business Engagement
  • - Demonstrated Experience
  • o    Providing thought leadership and business strategy acumen around advanced analytics and business information lifecycle
  • o    Leading customers through a value-based decision-making cycle
  • o    Developing functional, non-functional and technical requirements based on business imperatives
  • o    Presenting to customer executive teams with authority and purpose
  • Project and Team Delivery Leadership
  • · Demonstrated Experience
  • o    Directing business analysts and developers in the execution of project tasks
  • o    Leading consultants in various project work streams
  • o    Estimating, planning and executing advanced analytics solutions
  • o    Managing geographically distributed project teams
  • Remote (ALL US)

    Data Engineer