The Senior Systems Engineer works closely with both Data Architects and Developers and is responsible for ensuring data quality and cloud services is maintained across many company datasets by close monitoring/reporting of incoming data streams and development of processes to efficiently store and manage large data sets. The Senior Systems Engineer is an important role in building and maintaining the foundation for the company’s ongoing Big Data and Machine Learning/AI initiatives.
- Own and help design our production data back-end from the ground up in a fully scalable fashion
- Collaborate with fellow engineers on deploying resilient and scalable network architecture with minimal downtime.
- Review and onboard new technologies, ideas and processes
- Monitor incoming data streams for irregularities and errors, monitor performance of database and data warehouses, monitor any updates or changes from data providers/sources, research/suggest potential fixes for issues with existing ETL processes or data storage systems, interact with data vendors to ensure consistent data quality
- Report any potential issues with incoming data streams on a regular basis, develop KPIs and dashboards to help monitor the data quality of incoming data, develop systems for flagging potentially erroneous data, report on database performance issues and develop KPIs to monitor various performance metrics over time
What You Need for this Position
- Knowledge of Amazon Web Services (EC2, RDS)
- Minimum of 3 years experience in similar role
- Experience with cloud hosting services (e.g. AWS or GCE) with regards to network peering, performance tuning and perimeter security.
- Functional understanding of storage infrastructures
- Experience on Big Data infrastructures and technologies
- Working knowledge of at least one of PHP, R or Python and backend technologies
- Functional understanding of networking; routing, switching, firewalls, load balancers, proxy services, protocols and secure communications using SSL/TLS
And even better
- IT experience
- experience with web and mobile analytics platforms
- strong communication skills
- data security experience