Senior Software Engineer - Vault Data Access

Senior Software Engineer - Vault Data Access You've seen the headlines. Financial firms are fined millions of dollars when just one employee does something they shouldn't. It can be as serious as insider trading or as seemingly innocent as an inappropriate instant message. Keeping track of who is saying, doing, and trading what is a daunting task for compliance officers, especially with the explosion in the volume and variety of data produced by communications and trading platforms. That’s where Bloomberg Vault comes in. We are comprised of Bloomberg Vault Archive and Bloomberg Surveillance to provide a single platform for more than 1,000 organizations customers. Our clients use Bloomberg Vault to manage and archive their enterprise communications and collaboration data, including email, instant message (IM), mobile, files, trade and documents, voice data and social media. Our multi-tenant cloud processes 300 million messages daily and stores about 90 billion archived objects, and we are looking to grow significantly in the next two years. Your Role: In Bloomberg Vault, you’ll help us build large scale data processing and reporting systems that ingest, surveil, index and provide applications that package and deliver complex events streams spanning communication, collaboration, and financial transaction data. The Vault Data Access team is responsible for a suite of services that provide access to the data in the Vault archive. Our consumers are both client-facing applications and firms that subscribe to daily communications extracts. Delivery of these extracts is critical --- without them clients legally can’t use the terminal that day! While maintaining and enhancing our existing system, we’re currently building a new data processing pipeline using Scala and Apache Spark. Over the next year we will work to port our existing pipelines to this new platform. This is a hands-on technically challenging role, balancing understanding of complex existing systems with build-out of new strategic services, and backend processing with client-facing API’s. You’ll need to have: A desire to build robust, scalable, and maintainable systems Solid hands-on technical knowledge of C++ and Java, Scala, or Python BA, BS, MS, PhD in Computer Science, Engineering or related technology field We’d love to see: Experience with the Apache Hadoop Ecosystem (Spark, HDFS, Kafka, HBase, etc.) Cluster computing and containerization (Docker, Kubernetes, Calico, Istio, etc.) Passion for new technologies Passion for solving difficult problems Bloomberg is an equal opportunities employer, and we value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.