招数据开发工程师

Data Engineer 数据工程师
3-5 years,  25k-32k
1.    Expert experience with mainstream RDBMS like MySQL(mandatory), PostgreSQL, SQL Server and NoSQL such as Redis, HBase;
2.    Familiar with the distributed database architecture, ability to design the OLTP with high availability, scalability and performance; solid hands-on experience with distributed DB products in mainstream Cloud environment like AliCloud DRDS or GCP spanner; 
3.    Extensive experience in big data acquisition, pre-processing, storage, and cleansing technologies including Hadoop (HDFS, MapReduce, Yarn,..), Kafka, Sqoop, Spark, Flink and etc;
4.    Experience with programming languages: Python, Java, or Shell; 
5.    Knowledge of GraphQL is a plus
Responsibility:
1.    Responsible for designing, building, testing and maintaining data systems, making sure the data structure, ingestion and processing systems, supporting digital product teams’ requirements and user needs;
2.    Responsible for implementing methods to improve data reliability, efficiency and quality;
3.    Act as technical expert in regard to integration and connectivity methods, protocols, 
4.    security and practices for data management systems;
5.    Responsible for designing and creating the optimal data pipeline;
6.    Work closely with data architects/scientists and other stakeholders on future data handling technologies, including input on risks, costs, benefits