CAIA's Career Center is an easy-to-use, comprehensive resource connecting job seekers with employers in the growing AI field. Use your knowledge and credibility to advance your career or build a talented team for your organization. Opportunities targeted to CAIA Charterholders are prioritized.
In order to search for jobs specifically for CAIA Charterholders or those pursuing the CAIA Charter please enter “CAIA” in the search panel.
This will enable you to search for CAIA specific roles globally.
Big Data Engineering Lead This is a lead engineering role within the team responsible for BGC Partners' Big Data platform requiring a candidate with strong Scala, Spark and Java skills. The successful candidate will report to the Head of Big Data and Messaging in London and be responsible for working with senior developers to take BGC's Big Data platform to the next level, supporting technology and business use-cases involving both on-premise and Cloud implementations. This is a new role within the London Big Data team requiring close collaboration with the business-focussed lead developer who owns the data plant ETL framework. The team has expanded substantially in 2019 allowing a shift in focus to the next phase of building out the platform to provide comprehensive data services across the BGC and Cantor group of brands.
The platform delivers data solutions use-cases including regulatory reporting, surveillance, revenue analysis and market data analytics with a view to substantial expansion in quantity, velocity and accessibility of data.
Work within the Big Data team to provide Big Data engineering expertise to steer the development of the data plant through completion of its current phase leading to the development of a next generation platform to serve the expanding needs of the business
Integrate Data Warehousing and RDBMS solutions with the Big Data platform to enhance accessibility and analytical capabilities of the global platform
Work with the platform leadership team to identify and implement the effective application of resources to further the data goals of the organisation
Work closely with senior developers to further the goals of the platform leadership team, including hands-on application of architecture, design, development and testing competencies
Ensure systems are resilient, highly availability and conformant to Business Continuity requirements
Work in partnership with the business/business analysts to identify key requirements for implementation
Produce estimates for platform enhancements
Creation/updating of system functional and reference documentation
Ensuring timeliness and quality of deliverables
Provide mentorship and code review for the team
To identify any technical requirements for new products
To work with all the business and technology departments to ensure all business and technical requirements are met
To identify and manage any integration work
To analyse, design and build any such projects
To provide substantial input into the current and on-going system architecture
To liaise with other development teams as necessary to implement cross-team projects
Be alert to Conduct Risk issues, specifically the risk of harm to client interests, market integrity and/or competition in financial markets due to inappropriate practices or behaviours across the firm
To undertake and manage: Systems analysis, architecture and design; Systems development; Systems documentation; Production support and out-of-hours system maintenance
Experience in leading hands-on development of Big Data platforms covering the following languages and technologies:
RDBMS, eg PostGres, SQL Server, Oracle
Excellent relational and NoSQL data modelling skills
Able to demonstrate effective engineering leadership building at-scale real-time data platforms with high availability and efficient distribution/accessibility of data sets to stakeholders
Able to demonstrate the communication skills required to navigate the needs of stakeholders across a large organisation whilst also being adept at dealing with application development issues
Experience of software development in a financial services environment advantageous
Willingness to keep up to date with latest technology trends and proactively identify appropriate areas into which they can be applied
Experience in leading the integration and divesting of data services resulting from merger, acquisition and spin-off events highly beneficial
Experience in addressing efficient data storage and querying against very large stores, distributed across a global organisation
Experience with Ansible and Docker
Experience in migrating on-premise platforms to cloud architectures
AWS: Data Pipeline, S3, EMR, Lamda, DynamoDB, RedShift.
Experience in the use of high performance messaging middleware platforms, eg Tibco or Solace
Team player with excellent inter-personal skills and confident communication skills
Able to disseminate knowledge effectively to all team members
Ability to understand and respond to complex problems, draw and present the right insight and recommendations effectively
Ability to take complex business requirements and translate these into tangible, workable and commercially smart solutions leveraging best practice tools and techniques
Demonstrates commercial awareness with ability to identify, understand and advise on resourcing matters from a business perspective, establishing credibility, trust and respect from Senior Management
Must be able to deal with stakeholders effectively, including global development and business-focussed teams providing and consuming the team's Data products
Must be proactive in generating ideas and effective at developing solutions that are balanced and proportionate in collaboration with the global team
Must be able to deal with and adapt to change extremely effectively
Proven ability to thrive in a complex matrix environment, collaborate effectively with broader teams and galvanise support for projects, bringing people together to deliver
Proactive in improving quality of process and deliverables
Excellent spoken and written English, clear oral communication skills. Willing and able to express new ideas, concerns and opinions directly to wider teams in team meetings
High levels of self-awareness and committed to promoting a growth mindset within the team