Senior Data Engineer

Job: SC19683
SENIOR DATA ENGINEER
Location: Katy, TX
Type: Permanent

The Data Engineer is a key part of the Data Services Team that is responsible for building and maintaining enterprise-grade ETL, reporting and analytics solutions.

  • They are responsible for ensuring the team is consistently delivering performant, secure, and efficient solutions
  • They act as an example to the team members, collaborate closely with customers, and remove or escalate impediments
  • Additionally, they apply their knowledge of business intelligence/ data architecture principles, data warehousing, data structures, and analysis as a daily contributor
  • The ideal candidate will be able to actively sponsor continuous improvement within the team, the department, and the company
  • They will be able to have significant methodology experience with agile methodologies such as Scrum and Kanban
  • Develop data architecture and ETL solutions using sound, repeatable, industry standard methodologies
  • Enhance existing data systems and optimizing ETL systems
  • Lead development activities to migrate out of legacy technologies to cloud micro services driven Data Platform
  • Communicate and maintain Master Data, Metadata, Data Management Repositories, Logical Data Models, Data Standards
  • Create and maintain optimal data pipeline architecture by assembling large, complex data sets that meet functional / non-functional business requirements
  • Work with business partners on data-related technical issues and develop requirements to support their data infrastructure needs
  • Build industrialized analytic datasets and delivery mechanisms that utilize the data pipeline to deliver actionable insights into sales volume, products efficiency and other key business performance metrics
  • Contribute to architectural design and foster new ideas and innovations in our products

Qualifications

  • S. or M.S. in computer science or a related field, with academic knowledge of computer science (algorithms, data structures etc.) and 5 or more years of experience, or equivalent combination of education and or experience
  • At least 7 years of coding experience with SQL, ETL, Data Warehouse, Data Modeling, Data Engineering with a willingness and ability to learn new ones
  • Over 3 years of experience in building highly scalable ETL or DataOps pipelines including AWS (Glue etc.) or open source data technologies
  • Over 3 years of experience in applying principles, best practices, and trade-offs of schema design to various types of database technologies, including relational, columnar, graph, SQL, or NoSQL
  • At least 1 years of experience with database, data lake, and data mesh architecture designs with structured and unstructured data
  • At least 1 years of experience with implementing web services, including SOAP and RESTful APIs using micro services architectures and design patterns
  • Experience in implementing batch and real-time data integration frameworks and applications, in private or public cloud solutions
  • Experience with AWS or Azure using various technologies, including Spark, Impala, debugging, identifying performance bottlenecks, and fine tuning those frameworks
  • Knowledge of relational and dimensional modeling techniques
  • Proficient with Python, as well as knowledge of: C#, Java, Go, JavaScript, TypeScript, and/or R
  • Experience with BI tools such as Power BI, Sisense, Tableau, SSRS
  • Experience with PaaS/SaaS and cloud platforms such as Amazon AWS and Microsoft Azure
  • Experience with containerization technologies such as Docker and Kubernetes
  • Experience with service bus and messaging technologies such as NServiceBus, Amazon SQS, MSMQ, and RabbitMQ
  • Ability to conduct research on emerging technologies and industry trends independently
  • Knowledge of Git (GitHub, Bitbucket, or similar) and DevOps (repos, pipelines, testing)
  • Experience building enterprise applications, including integration with COTS systems
  • Type: Permanent
  • Category: IT
  • Date Posted: 2023-10-13
JOB SOURCE: HEADHUNTER
Job offer posted by a headhunter on Experteer
Sign up and apply now

The Experteer Benchmark is an Experteer service that shows you the estimated market value of a specific position. It is not given by the recruiters, and it is an estimate based solely on market data.

Experteer's estimation is based on both the analysis of internal data, as well as external information. The Experteer Benchmark is the average market value at the respective level. This value may be up to 15% higher or lower in each company (greater variation may be possible in individual cases).

The Recruiter Benchmark serves as a reference. The actual salary to be obtained depends on factors such as professional experience and expertise.