Big Data QA Job

Job Title: Big Data QA Engineer
We are seeking a highly skilled and motivated Big Data QA Engineer with expertise in automation testing using Java or Python programming languages. The ideal candidate should possess a strong background in data validation, data verification, PySpark, pipeline monitoring, software testing fundamentals, STLC (Software Testing Life Cycle), MongoDB, and database testing.
Key Responsibilities:
Automation Testing:
Develop and maintain automated test scripts using Java or Python for Big Data applications.
Implement test automation frameworks and tools to enhance the efficiency and effectiveness of the testing process.
Data Validation and Verification:
Design and execute test cases to validate and verify large datasets, ensuring data accuracy and integrity.
Identify and report data discrepancies or anomalies.
Pipeline Monitoring:
Monitor and evaluate data pipelines for performance, reliability, and scalability.
Implement strategies for identifying and resolving issues in data processing pipelines.
Software Testing Fundamentals:
Apply sound software testing principles and methodologies to ensure high-quality deliverables.
Collaborate with development and product teams to understand requirements and design comprehensive test plans.
STLC (Software Testing Life Cycle):
Manage and execute test cycles throughout the SDLC.
Collaborate with cross-functional teams to ensure comprehensive test coverage.
MongoDB and Database Testing:
Conduct testing of MongoDB databases and other data storage systems.
Develop and execute SQL queries for database testing purposes.

Information above is Internshala's interpretation and paraphrasing of what we found on the shared link.