Email: [email protected]
I'm currently working as Senior Software Engineer at LinkedIn (SlideShare).
Summary of current/previous work:
-
At Cleartrip Travels [www.cleartrip.com], I was part of the backend team that developed Flight/Hotel search/booking system. I was in the flights team. I along with my mentor designed and implemented International Flight Search product in Common Lisp using ITA API. I also worked on building some internal admin tools and internal/external API for search/booking for flights.
-
At Infinitely Beta Technologies, I worked on building a financial portal using Clojure among many other things. I was part of the backend team that exposed REST API for frontend.
-
At Slideshare, I'm part of Analytics data backend team and working currently on a new version of the product using Hadoop/HBase/Pig/Oozie. I've also worked on Search and Social API products.
Code:
- HBase Utils: https://github.com/nipra/scratch/tree/master/src/hbase
- Index PDF files available in a local directory: https://github.com/nipra/scratch/blob/master/src/search/index_pdfs.clj
- Lucene related snippets: https://github.com/nipra/scratch/tree/master/src/search/lucene
- MongoDB related: https://github.com/nipra/scratch/blob/master/src/mongo
- Postgres snippets: https://github.com/nipra/fun/blob/master/src/pg/utils.clj
Resume: https://www.dropbox.com/s/inygp31j085rvzt/r%C3%A9sum%C3%A9.pdf
• Working on the SlideShare product (http://www.slideshare.net). LinkedIn acquired SlideShare in May 2012. SlideShare + LinkedIn = More Value for Professionals: http://blog.linkedin.com/2012/05/03/slideshare-linkedin-more-value-for-professionals/
• Part of Analytics data backend team and working on a new scalable version of the analytics product using Hadoop/HBase/Pig/Oozie.
• Blog posts related to various product launches:
-
PRO Analytics Are Now Faster, Simpler, Better: http://blog.slideshare.net/2013/07/25/pro-analytics-are-now-faster-simpler-better/
-
Hadoop and Near Real Time Analytics at SlideShare: http://engineering.slideshare.net/2014/04/hadoop-and-near-real-time-analytics-at-slideshare/ This blog post was mentioned in Hadoop Weekly Issue #66: http://www.hadoopweekly.com/Hadoop-Weekly-66.html
-
Analytics Now Available to All Users: http://blog.slideshare.net/2014/12/11/analytics-now-available-to-all-users/
• Responsibilities:
- Writing MR jobs using Pig and Java
- Designing HBase table schemas
- Writing Oozie workflows
- Improving overall data processing workflow time
- Taking care of overall cluster health along with ops team
- Taking architectural decisions
- Technology selection
- Capacity planning
- Driving various ops related efforts
- Writing scripts for creating, truncating, dropping, altering HBase tables
- Deep dive into various configuration parameters for Hadoop, HBase, Pig, TorqueBox
- Own, maintain, improve aggregation layer (Sinatra app) written in JRuby/TorqueBox
• Previously worked on search, newsfeed and built a REST API for follow/unfollow activities.
• Technologies Used: Hadoop, HBase, Apache Phoenix, Pig, Oozie, TorqueBox, JRuby, Clojure, Ruby, Sinatra, MySQL, Solr, MongoDB
• Part of the backend team which built and launched http://www.paisa.com/, a financial portal for managing your portfolio and getting latest updates about BSE/NSE quotes
• Wrote services for fetching BSE/NSE quotes which get updated every 5/10 minutes
• Wrote scrapers for fetching BSE/NSE historical data from the official sites
• Administration and tuning of MongoDB
• Part of the backend team which built Quora like Q&A cum customer support site which is a software as a service (SAAS) platform
• Designed and implemented badges system like stackoverflow for qotd.co using MapReduce feature of MongoDB
• Part of the team which built Clojure wrappers for MongoDB Java driver, Redis Java client (Jedis), RabbitMQ Java client. We also used code from available open source projects.
• During various AWS outages, led the team to recover MongoDB data from slave and putting back the system to a sane state
• Learned fabric and supervisord tools for administration
• Wrote Python scripts for taking MongoDB backup using mongodump utility and uploading to Amazon S3
• Did a lot of experimentation to get a hands on knowledge of MongoDB sharding and replication features on a heavy local machine. Test setup consisted of 10-15 virtual machine nodes. Wrote Python scripts using fabric to automate this process of setting up the cluster.
• Part of the team which used Redis to implement a feed system
• Was part of the team that scraped Oracle Java forums, HTC forums, etc. using Scrapy Python library/tool and loaded data in DB for demoing to prospective customers of Qotd.co
• Wrote a system to incrementally fetch emails using Python imaplib library
• Designed and implemented queuing system using RabbitMQ to offload various works that can be done asynchronously e.g. sending notification, fetching mail, sending tweets.
• Technologies Used: Clojure, Python, MongoDB, Redis, RabbitMQ, Compojure, Git, EC2, S3, Scrapy, Supervisord, Fabric
• Integrated routing for domestic flight search with existing system along with another team member
• Worked on search system of IC airline along with another team member
• Maintaining and improving internal and external API for flight search and booking
• Designed and implemented international flight search along with another team member
• Worked on booking system for flights along with other team members
• Worked on payment gateway manager to check the authentication of a card along with another team member
• Wrote a couple of internal admin tools
• Technologies Used: Allegro Common Lisp, Allegro Cache, Memcached, Hunchentoot, HTML-TEMPLATE
• Basic Linux sysadmin stuff. Period of learning Perl.
Git
MongoDB
Ruby
Python
Hadoop
MySQL
Emacs
Linux
Clojure
Open Source
Web Applications
Perl
Common Lisp
Redis
Solr
MapReduce
Amazon EC2
HBase
Memcached
Lucene
XML
RabbitMQ
REST
NoSQL
Pig
Oozie
I met and was friends with Nipra since when, he joined Cleartrip. But we worked together for about a year towards the end of our stints at Cleartrip. It was fun working with him. He played major role in implementing International Air Search, Multi-city Air Search, External Search/Book API etc. For any problem we discussed together, he always used to come up with simpler and efficient solutions.
Nipra is a very disciplined programmer. His code-quality is always note perfect. Always ready to learn and explore. Very hard working with great analytical skills. And yes he loves Emacs :) I would highly recommend to have Nipra on any team. Prashant Acharekar
Nikhil (better known as Nipra) and I did a lot of work together on the air product at Cleartrip. During that time, Nipra directly handled (developed and managed) many important sub-systems of the air product, including international search, parts of the booking engine, and some nifty utilities for administration of the air product.
It was stellar work. Any work handed over to Nipra would be done on time and without any major hiccups. And the code quality would be top-notch. He is an asset to have in any team -- I would highly recommend him. Chaitanya Gupta