Senior Data Engineer - Internal
Duties & Responsibilities:
● Responsible for developing and supporting data pipelines that support and enable the
overall strategy of expanded data programs, services, process optimization, and
advanced business intelligence
● Design and develop scalable data warehousing solutions, building ETL pipelines in Big
Data environments (cloud, on-prem, hybrid)
● Leading data discovery sessions with business teams, comprising product owners, data
analysts, and cross-team technologists to understand enterprise data requirements of
analytics projects
● Ensure proper testing and monitoring are in place to provide trusted and reliable data
from the data stack.
● Partner with business domain experts, system analysts, data/application architects, and
development teams to ensure data design is aligned with business strategy and direction
● Identify and document standard methodologies, standards, and architecture guidelines
● Dive deep, as required, to assist Business Intelligence Engineers through technical
hurdles impacting delivery
● Participating in a shared on-call rotation monitoring the health of the team’s systems
Essential Knowledge, Skills, and Abilities:
● 3+ years of data architecture related experience such as data analysis, data modeling,
and data integration.
● 5+ years of Experience in custom ETL design, implementation, and maintenance
● Advanced Knowledge of programming languages (e.g. Python and Object Oriented
Programming)
● Hands-on experience with SQL database design
● Experience working on Cloud Platforms (AWS or Google )
● Experience working on CI/CD processes and source control tools such as GitHub and
GitLab
● Experience working with relational databases (Snowflake, Redshift)
● Strong knowledge of orchestration tools (AirFlow Preferred), file storage systems(AWS
S3, Google Cloud Storage), partitioning, and real-time processing of data
● Strong knowledge and experience with Agile/Scrum methodology and iterative practices
in a service delivery lifecycle
● Excellent communication and interpersonal skills with a demonstrated ability to influence
a large organization
● Bachelor’s or Master’s Degree in Computer Science, Information Systems, or related
field
Bonus Points: ( specific project )
● Experience working with reporting tools such as Tableau
● Experience with event streaming with modern event streaming toolings like Kafka or
Kinesis.