Job Description
Job Title: Big Data Engineer
Location: Plano, TX (Onsite)
Position: Contract Position
Local Candidate with Local DL
JOB DESCRIPTION:
- Design and develop ETL (Extract, Transform, Load) processes and database systems.
- Build tools for real-time and offline analytic processing.
- Troubleshoot data and software issues to ensure data consistency, accuracy, and integrity.
- Integrate large and complex data sets from various sources to enable data-driven business insights.
- Translate business specifications into technical design and production-quality code.
- Write complex programs, ad hoc queries, and reports , ensuring all deliverables are well-structured, documented, and reusable.
- Collaborate closely with business partners to understand functional requirements and data needs.
- Work with cross-functional technical and analytics teams to implement scalable and efficient data solutions.
- Lead all phases of data solution development and provide technical input in project meetings.
- Assess data quality, conduct rigorous testing , and ensure high accuracy in all deliverables.
- Serve as a technical consultant to internal clients and guide junior data engineers, ensuring quality control.
- Contribute to the development of data engineering standards and best practices across teams.
- Participate in software testing, regression testing, and production deployment.
- Coordinate with vendors to resolve technical issues and enhance software systems.
- Participate in special projects and ad hoc assignments as required.
Required Skills & Qualifications:
- Strong technical expertise in: Python, SQL, Hive, Spark
- AWS / Cloud Computing (e.g., Elastic MapReduce, EC2, S3)
- Bash / Shell Scripting
- Proven experience writing production-quality code to create scalable and reliable data products.
- Excellent understanding of data integration, data pipelines, and distributed data systems.
- Strong ability to communicate technical concepts to non-technical audiences effectively.
- Experience working within Agile delivery methodologies.
- Ability to lead projects, mentor others, and maintain high standards of data quality and engineering practices.
Job Tags
Contract work, Local area,