Description
Trovicor is seeking a Data Engineer with advanced proficiency in Java, significant experience with Apache NiFi, and a strong foundation in using columnar databases for real column queries. The ideal candidate will bring a depth of experience in data engineering disciplines, including the use of Fast API framework, and documented proficiency in Python. This role demands an individual who can apply their knowledge practically and innovatively to solve complex problems, seamlessly integrate disparate data systems, and contribute to the strategic data architecture decisions. Applicants must demonstrate their experience through detailed accounts in their resume or CV, moving beyond mere keywords to showcase tangible achievements and contributions.
Requirements
1. 10+ years of experience in Java, with extensive knowledge in developing scalable data processing solutions.
2. 5+ years of hands-on experience with Apache NiFi, demonstrating advanced knowledge in data flows and process automation.
3. Proven experience with columnar databases such as ClickHouse, Cassandra, Snowflake, or Amazon Redshift, especially in crafting and executing complex columnar queries.
4. Practical experience with the Fast API framework, showcasing ability to develop high performance, scalable APIs.
5. Documented proficiency in Python, with examples of previous projects or contributions that required significant Python coding.
6. Ability to articulate and showcase data engineering solutions and methodologies clearly in a resume or CV.
Desirable
1. Experience with data modeling and ETL processes.
2. Familiarity with cloud services and architectures, especially AWS or Azure.
3. Strong analytical skills and ability to work with complex datasets.