Job details

Data Engineer (MySQL)

Get a free resume review

Solvd Inc. is a premier software engineering company. We have 8 offices across the globe and over 800 international employees on staff. With over 12 years of experience, highly skilled teams around the world and deep industry knowledge, we help clients create software that improves their operations and opens new markets. We have built an impressive roster of digital-native enterprise clients including some of the biggest brands in retail and social media.

We are looking for a Data Engineer (MySQL) to join our growing team.

Responsibilities:

Data Lake Design & Architecture:
Design a scalable and efficient data lake architecture to store ONIX data in MySQL.
Define the schema, tables, indexing strategies, partitioning and relationships to optimize data storage and retrieval.
Data Mapping:
Analyze ONIX data (XML) and map it to MySQL tables and fields.
Ensure data integrity and consistency during the mapping process.
Data Ingestion Pipeline:
Develop data ingestion pipelines for both on-demand and periodic updates (e.g., daily, hourly).
Integrate support for additional data formats (CSV, Google Sheets, Excel).
Stored Procedures and Queries:
Write efficient stored procedures, queries, and joins to process and format data.
Optimize database performance for large datasets.
API Development:
Design and build RESTful APIs to expose formatted data from MySQL.
Ensure APIs are scalable, secure, and well-documented.
Consulting:
Act as a consultant to the client, providing guidance on best practices for database design, data ingestion, and API development.
Collaborate with the client’s team to understand requirements and deliver solutions.
Testing and Validation:
Perform thorough testing of the data lake, ingestion pipelines, and APIs.
Validate data accuracy, consistency, and performance.
Documentation:
Create detailed documentation for the data lake architecture, ingestion pipelines, stored procedures, and APIs.
Provide training and support to the client’s team.

Mandatory requirements:

At least 4 years of experience in software engineering.
Proficiency in RDBMS (database design, stored procedures, query optimization).
Experience with data ingestion pipelines (ETL/ELT) and tools (e.g., Apache NiFi, Talend, custom scripts).
Strong knowledge of data mapping and data modeling.
Expertise in API development (RESTful APIs, GraphQL).
Proficiency in Python, Java, or Node.js for backend development.
Experience with XML parsing and handling other data formats (CSV, Excel, Google Sheets).
Advanced knowledge of SQL (joins, subqueries, indexing, partitioning).
Experience with database performance tuning and scalability.
Strong communication and client-facing skills.
Problem-solving and analytical abilities.
Ability to work independently and deliver results in a remote environment.

Optional requirements:

Experience with cloud-based database solutions such as AWS RDS, Google Cloud SQL, or Azure Database for MySQL.
Familiarity with containerization and orchestration (Docker, Kubernetes).
Experience with real-time data processing technologies (Kafka, Apache Flink).

Average salary estimate

$100000 / YEARLY (est.)

min

max

$80000K

$120000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

What You Should Know About Data Engineer (MySQL), Solvd

Join Solvd Inc., a premier software engineering company with over 12 years of experience and 800 international employees, as a Data Engineer (MySQL)! We take pride in helping our clients thrive by building innovative software that transforms their operations. You'll be at the forefront of data architecture as you design scalable data lakes and craft efficient data ingestion pipelines. With our diverse range of clients, including major brands in retail and social media, your work will have a significant impact on global operations. As a Data Engineer, you'll analyze and map ONIX data, ensuring integrity while optimizing database performance. You will also develop RESTful APIs to expose and deliver formatted data securely. Your strong proficiency in SQL and experience with data modeling, integration, and ETL/ELT tools will be essential as you collaborate with clients to provide solutions that exceed their expectations. We value problem-solvers and communicators who can work independently in a remote setting. If you're eager to join a dynamic team and utilize your skills in Python, Java, or Node.js, we’d love to hear from you and see how you can contribute to our ongoing success!

Frequently Asked Questions (FAQs) for Data Engineer (MySQL) Role at Solvd

What are the main responsibilities of a Data Engineer (MySQL) at Solvd Inc.?

As a Data Engineer (MySQL) at Solvd Inc., your key responsibilities will include designing scalable data lake architectures, developing data ingestion pipelines, and creating efficient stored procedures and queries. You'll also be tasked with API development for data access, along with consulting clients on best practices for database performance and integrity. Your expertise in handling various data formats and ensuring data quality will be vital in this role.