Big Data Engineer
hace 1 día
Charlotte
We are At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 14,500+, and has 58 offices in 21 countries within key global markets. Our Challenge: We are looking for an experienced Big Data Engineer with strong Software Engineering skills to design, develop, and optimize large-scale data processing systems. The ideal candidate will have expertise in ETL workflows within big data environments, leveraging a broad spectrum of technologies to build scalable and efficient data pipelines and analytics solutions. Additional Information* The base salary for this position will vary based on geography and other factors. In accordance with law, the base salary for this role if filled within Charlotte, NC is $100K - $110K/year & benefits (see below). Responsibilities: • Design, develop, and maintain robust ETL pipelines using big data tools such as Apache Hadoop, Spark, and Hive., • Implement data processing and transformation using Pyspark, Python, and Scala to support data science and analytics initiatives., • Optimize data workflows for performance, scalability, and reliability in a distributed environment., • Collaborate with data scientists, analysts, and business teams to understand data requirements and deliver effective data solutions., • Manage integration and interaction with RDBMS and other databases to enhance data accessibility., • Develop automation scripts and workflows using UNIX/Linux shell scripting., • Create and deliver insightful PowerBI reports and dashboards for data visualization and reporting., • Troubleshoot issues related to data pipelines and provide timely resolutions., • Stay updated with the latest big data technologies and contribute to continuous improvement initiatives., • Work with cross-functional teams to ensure data security, quality, and compliance standards are maintained. Requirements: • Proven experience in software engineering with a focus on big data ETL development., • Hands-on experience with Apache Hadoop, Spark, Hive, and Pyspark/Python., • Strong programming skills in Scala and Python., • Demonstrated experience working with RDBMS and other database systems., • Proficiency in UNIX/Linux shell scripting., • Experience building and maintaining PowerBI reports and dashboards., • Ability to lead technical initiatives and mentor junior team members., • Excellent analytical, problem-solving, and communication skills. Preferred, but not required: • Cloud platform experience (AWS, Azure, GCP) is a plus., • Knowledge of data warehousing, data modeling, and real-time data processing., • Familiarity with containerization tools such as Docker and orchestration frameworks like Kubernetes. We offer: • A highly competitive compensation and benefits package., • A multinational organization with 58 offices in 21 countries and the possibility to work abroad., • 10 days of paid annual leave (plus sick leave and national holidays)., • Maternity & paternity leave plans., • A comprehensive insurance plan including medical, dental, vision, life insurance, and long-/short-term disability (plans vary by region)., • Retirement savings plans., • A higher education certification policy., • Commuter benefits (varies by region)., • Extensive training opportunities, focused on skills, substantive knowledge, and personal development., • On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses., • Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups., • Cutting edge projects at the world’s leading tier-one banks, financial institutions and insurance firms., • A flat and approachable organization., • A truly diverse, fun-loving, and global work culture. SYNECHRON’S DIVERSITY & INCLUSION STATEMENT: Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more. All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.