Vertica

Archive for the ‘interns’ Category

Building Bridges with Gumdrops and Toothpicks

soniyaBlogPic2

In June 2014, the HP Vertica summer interns headed to the East End House in East Cambridge, MA to work with students through a community service project. Sarah Perkins, a business planner on the Project Management team, organized the project. Since 1875, the East End House has offered innovative programs to the community and continues to strive for excellence. Their programs help support families and individuals through curricula that enhance education standards. Programming supports the whole family with comprehensive services like a Food Pantry, Community Workshops, Parent Education and Senior Programming.

The interns, accompanied by mentors Sarah Lemaire and Jaimin Dave, helped students build bridges with very limited materials: fifty gumdrops and one hundred toothpicks! The goal was to build a bridge that spanned a six-inch gap and would hold at least 300 grams, or 120 pennies.

Teams of interns paired up to work with four students, ranging from third to eighth grade. They watched and assisted as the students discussed strategies, drew prototypes and started to build and re-build their structures. As the students worked on their bridges, they got to know more about the Vertica interns, including their majors, hometowns, and the projects they are working on for the summer. Throughout the course of the day, if students could correctly answer questions about their interns, they would win HP Vertica swag, including toy bulldozers, stress balls, flashlights, and more.

Once the bridges were built, the interns and students tested them across a six-inch gap. Students placed pennies on a paper plate on top of the bridge, one-by-one, until the bridge collapsed under the weight. The winning team’s bridge, led by interns Swikriti Jain and Jun Yin, held 255 pennies, which weigh more than 1 1/3 pounds! The top two teams won a bundle of HP Vertica swag, including t-shirts, water bottles, and baseballs.

The HP Vertica interns had a great time learning about students at the East End House, and helping them build successful bridges. It was a unique opportunity to interact with students of many ages, while also encouraging them to remain active in school and participate in extracurricular activities.

Work hard, have fun and make a difference!

JaminBlogPic

My name is Jaimin and I work as a Software Engineer in the Distributed Query Optimizer Team at HP Vertica. I wanted to share with you what I think makes Vertica the best place to work! I will explain the kind of impact you can make as an employee/intern at HP Vertica, while sharing my personal experiences.

As a student, I researched many companies I might want to work for to get a better understanding of the everyday life of software engineers. However, what I was most interested in learning about was the kinds of things engineers might do that went above and beyond the normal day-to-day stuff.

Is writing code something unique to the job?

No! Right?

As Software Engineers, we write code, develop algorithms, and implement them. But here at HP Vertica, we do lots of other things besides simply writing code.

Go above and beyond!

Vertica is different from other companies as far as normal day-to-day stuff goes.

Let me ask you this question: How many new graduates would you guess could get a chance to file a patent within their first 6 months of joining a company? How many would get chance to write a paper within first six months? Not a lot, right?

In my experience at HP Vertica, I’ve seen that just about all new graduate engineers file at least one patent in their first year at work. This speaks to the fact that the work we do here at Vertica is completely innovative. Our projects have a huge business impact.

Be the captain of your ship!

Vertica offers engineers incredible opportunities! All you have to do is be willing to accept them. One of the best things about HP Vertica is that you work in an environment where other engineers are smarter than you! You’ll find yourself constantly challenged to learn new, interesting, and exciting things. You’ll get better exposure and, more importantly, you have a massive role to play in the company’s growth and development.

Something else that’s unique about HP Vertica—the projects you work on as an intern become part of the shipping product! As a result, you’ll get the chance to see your code in action and sometimes you can learn what customers have to say about your feature in particular. You won’t be allowed to sit idle for a minute because we have a very short release cycle. This will keep you on your toes and encourage you to think something new day in and day out.

Here, engineers are not forced to work on this and that—they have a great deal of autonomy and frequently get to choose the things they work on. If you have an idea you think can help improve the product, you are encouraged to see it through. And, you’ll also get a chance to participate in various technical events that take place within HP and submit your ideas.

Taking initiative is always encouraged and you’ll be expected to make, discuss, and defend your design decisions with your mentors instead of just following directions. You’ll also be able to learn about the complexities of building a database and how we achieve the performance advantages in HP Vertica.

It is also easy to move between the teams. It is entirely up to you and the only question is what you want to do?

Share and gain knowledge!

Knowledge Sharing is another important thing at Vertica. We do a lunch talk where we discuss any new paper related to database systems. Every now and then people from various teams give tech talks so that each team is aware of what people in other groups are doing.

As a fresh graduate before joining Vertica, I did not have any experience working on a database optimizer product, though I had worked a bit on optimizations when I took a compiler class. Because of the great culture and environment at Vertica, I didn’t find the transition difficult at all. Sometimes it was challenging, but it allowed me to learn a lot by working with incredibly smart people at the company while working on challenging projects (I wonder how many people have the opportunity to work on the design and implementation of queries involving Set Operators during their first year of work).

Have fun!

We frequently unwind doing fun things at work, including watching the Olympics games or other sporting events during lunch, or playing table-tennis and board games when we can. Vertica provides a lot of flexibility and it comes with huge responsibility. You’re expected to get your work done on time—if you do that, no one will have any problem with having a little fun. Interns also go on outdoor field trips, including horseback riding, hiking to Blue Hills, going for a movie, participating in a bocce tournament, and water activities such as motor boat racing. Once, we went to the Boston Harbor and tried to learn how to sail a boat from one of our in-house experts in Vertica.

We are looking for people to join Vertica! Do you have any interest in being challenged in an innovative design environment? Then apply today!

HP Vertica Intern Program – No Coffee Runs Required

“No one asked me to fetch coffee for them.” —HP Vertica 2013 summer intern

Does anyone really ask an intern to go for coffee these days? Lucky for the intern I mentored this summer, I don’t drink coffee.

When I arrived at HP Vertica in July 2012, one of the first things I noticed was the great summer intern program. The interns were fully integrated into life at HP Vertica, developing features for the product, participating in design discussions, and giving presentations about their work. As a group, they had a great camaraderie, working hard while having fun.

When the opportunity presented itself, I volunteered to be a mentor for the summer of 2013. The documentation team has an intern every summer, and luckily for us, last year’s summer intern is now a permanent member of our team. I was helping out the team by volunteering….but really I wanted to join in the fun that the interns and mentors have.

Adam Seering did a great job organizing the intern program this summer, managing the recruitment of mentors and the development interns, and letting us know what was expected of us mentors: good communication, meaningful work assignments, and a positive attitude. We want HP Vertica interns to go back to their universities and tell people what a great workplace we have. Some of our best hires have been former interns and friends of former interns!

Of course, we want our interns to work hard, but with this summer’s interns hailing from Georgia, California, North Carolina, Pennsylvania, New York, and, of course, Massachusetts, we really wanted them to experience Boston. Our first outing was a trip to see the movie Star Trek Into Darkness. As the summer progressed, we climbed the Great Blue Hill in Milton, visited the MIT Museum, hosted an ice cream party on one of the hottest summer days, went horseback riding, and celebrated the summer with a lakeside party at Shilpa’s house. Most of the interns rode on inflated tubes behind a power boat on Forge Pond, with CSE’s Alex Jackson steering the boat in an effort to knock them off!

Oh, and the interns did some real work as well. They worked on interesting projects that are important to the company, and they shared their work with the rest of the organization. The most common theme I heard was, “Everyone at HP Vertica is happy to take the time to answer my questions.” Near the end of the summer, Sumeet Keswani organized a coding competition to see who could design the coolest app for HP Vertica’s AMI. First prize was a toy light saber, which Tech Support director Amy Miller had to try out before passing it on to the winner, Wei, an RPI grad student who developed a cool app called “Tweetica,” which collected and analyzed tweets. (Did you know that the most trending topic in the Boston area is the Red Sox? If not, you should have guessed that!)

In August, Boston was the site of HP Vertica’s first annual Big Data Conference. The marketing interns focused on this event—planning, recruiting volunteers, registering attendees, handling communications, talking to customers at the event, and in general, making sure everything ran smoothly. Their contributions were a big reason why the conference was so successful.

Vicki, our documentation intern, arrived from southern California, to daily rain followed by two weeks of heat and humidity. What she learned about Boston weather: “I have to bring an umbrella every day.” In addition to writing traditional documentation, she produced a great video about the intern program itself, which you can see for yourself below. She had a great time filming and editing it, and the interns enjoyed participating.

We will start recruiting for the 2014 summer interns this fall. Keep an eye out at www.vertica.com/careers.

InternVideo2013 from Vertica Systems on Vimeo.

Hiking with Interns!

HP Vertica’s Summer Intern program is up to 9 interns this year. HP Vertica has experienced tremendous growth recently with 76 new employees hired this year alone. Several of the interns are working on projects to be released with the next version of Vertica, while others are helping with the organization and marketing of the first ever HP Vertica Big Data Conference from August 5th-7th.

Sunday June 23rd was the second annual intern hiking trip. This year’s HP Vertica summer interns, their mentors, managers and some family members ventured out to Blue Hills Reservation, a Massachusetts State Park in Norfolk County. With bags of trail mix, water bottles and plenty of sunscreen, the group trekked up a mile to the peak for a beautiful view point.

The group finished off a fun, but hot, day with food at the Hillside Pub in Canton. Individuals from various teams across HP Vertica had the chance to catch up, share what they are working on and enjoy each other’s company!

Avro parser UDx – Using Apache Avro to enable easier data transfer from Hadoop to Vertica

After careful research and brainstorming of different ideas for the intern UDx competition we decided to implement an Avro parser UDx. Our team, “The Avro-rian Revolutionaries” wanted to implement something useful, ready to use, and is in the top-3 wish list of customers. And what better than an Avro parser which would help users to easily transfer data from Hadoop to Vertica!. (This Avro parser UDx package is now available on github [6] and Vertica users are encouraged to try it out!)

Apache Avro [1] is a data serialization format widely used in Hadoop world. It is a new data serialization format which succeeds Thrift [2] and Protocol Buffers [3]. According to some technologists, Avro is the best data serialization framework out there [4]. This was good motivation for us to implement an Avro parser for the intern competition, hoping to make importing Avro data into Vertica, feasible.

Figure 1. Hadoop, Avro, Avro UDx and Vertica workflow

With this motivation, we began our day 1 of the 5 day intern competition. The first milestone was to get the standalone Avro parser to work. This basic, standalone parser (still no Vertica in picture) which will just read an Avro file and print out the header and data in text format. The Avro API’s were our means to do it and by referring the basic documentation [5] we quickly came up with a parser which could dump out the contents of a sample Avro file in text format as in Figure 2.

Figure 2: weather.avro sample file in text format.

We spent day 2 of the competition learning the Vertica SDK, the next tool of trade.
There were some great examples already out there on github. We picked a simple example UDx and began using and playing with it. Once we got our hands on loading, testing, and running this UDx we started learning the required SDK interfaces for loading the data into Vertica. One important interface was called UDParser which parses a stream of bytes parallelly into Vertica. Very quickly we were able to use this and develop an UDx skeleton, ready to get integrated into the module developed on day 1.

On day 3, midway through the competition we had the most important milestone to achieve. The task was to integrate our standalone Avro parser developed on day 1 with a parser UDx skeleton developed on day 2. And this was point where we got stuck and had an unexpected setback. After talking to our mentors we discovered that there is an interface gap between Avro file reader api and Vertica UDParser interface. To fill this gap we developed a couple of modules called CRReader and CRStream which successfully addressed the issue.

Day 4, we began integrating the modules, and finally the moment of judgement arrived. This was the moment when we ran our first test of loading a weather.avro file into vertica, which exercised most of the code we wrote. And we did not have to hold our breath long. Within a fraction of a second the data was loaded into Vertica. We really couldn’t believe our eyes that all the 3 pieces of modules we wrote in 3 days are working like parts of an engine. The magic of UDx was happening! and the Avro file was successfully loaded into Vertica. (Figure 3)

Figure 3: Demo screenshot

On day 5, the last day of the competition, we spent all our efforts in testing and packaging the UDx. We wanted to have a quality product which will be ready to use by the customer by the end of competition.

Finally we presented our work with other interns in front of a fully packed room with audience from all departments of Vertica. This was a unique experience by itself because we had to present the work in the most appealing format for audience of different perspective apart from the technical dimension. End of the day we were happy that we learnt lots of new things, collaborated with senior mentors and received great response feedback and comments for our work which made the competition a great success! And now when looking at our UDx parser available on github[6] and ready to use, it gives us great satisfaction of achieving of our first step of getting one step closer to the Avro-rian revolution!

References:
[1] http://avro.apache.org/docs/1.7.1/
[2] http://wiki.apache.org/thrift/FrontPage
[3] http://code.google.com/p/protobuf/
[4] http://www.cloudera.com/blog/2011/05/three-reasons-why-apache-avro-data-serialization-is-a-good-choice-for-openrtb/
[5] http://avro.apache.org/docs/1.6.1/api/cpp/html/index.html
[6] https://github.com/vertica/Vertica-Extension-Packages/tree/master/avro_parser

Big Interns For Big Data

“[My wife] won’t let me talk about work anymore.” — Intern overheard talking at lunch

Quotes can be forged, but casual lunchtime conversation tends to be very candid. Indeed, it’s the indirect signals that mean to the most to me as I coordinate the intern program for the second year.

Another intern expressed delighted surprise at how well the interns are integrated into our teams. I take serious pride in this trait of the Vertica Summer Intern Program, as we ensure our interns each have at least one personal mentor and project that matters to us and to them. With eight interns this year, we have them doing everything from releasing features to customers and researching ways to improve performance to analyzing Vertica usage patterns and improving our testing framework. Our interns represented some geographic diversity, hailing from MIT, UVa, UMass Amherst, University of Houston, Brown and Purdue. The program has doubled and with good reason – in the last six months, two of our interns from 2011 have started full-time, as did a fellow co-intern of mine from back in 2009.

We encourage our interns to work their 40 hours and then enjoy Boston. Still, during the week-long Intern User-Defined-Function Contest, one of the eventual winners told me at 10 PM he wanted to skip school and come work at Vertica, while another pair of interns extended their internships. Though all will be returning to school in the fall, I’m thrilled that we can inspire the interns this deeply and grateful to all my coworkers who helped choose them from the candidate pool.

Vertica intern party

Annual intern party at Shilpa's, complete with (brand new) traditions of single-ski water skiing and watermelon carving. Photos taken by Ramachandra CN

But it’s not all work at Vertica. Along with individual lunches with Vertica’s top-brass, we managed hiking trips, poker nights (intern-organized!), creative four-player bocce matches, horse riding, and water skiing. Trust Vertica interns to even take the weekly Counter Strike game and turn it into a data-collection event, loading in-game kill locations into a Vertica database. I leave you with a level heatmap produced by our interns’ very own Vertica User-Defined-Function.

Heat Map

Here we see the deadliest locations of the Counter Strike map Italy. Though the concentration of carnage while attempting to rescue the hostages in the upper left is unsurprising, we can also understand how dangerous each of the access paths to the hostages are. For the same contest, the other interns created an AVRO parser, a JSON parser, and an automatic email-sending function for their contest entries. Heat map from Mark Fay and Matt Fay

We’ll be keeping in touch with this year’s crop of interns as they finish here and return to their respective academic programs. Many people have helped with the intern program this year, but I feel Adam Seering deserves special mention for all his work in making this summer a success. I also appreciate the support our coworkers have given the intern program from 1-on-1 help to attending the intern presentations in numbers.

Thank you Vertica 2012 interns for all your hard work this summer. You have no idea how much positive feedback I’ve heard about you all!

Our interns ending a successful summer by riding off into the sunset. Literally.

Our interns ending a successful summer by riding off into the sunset. Literally. Photo taken by Ramachandra CN.

Back to School with Big Data

In case you missed it, we’ve spent much of this past week featuring some of the awesome projects our brilliant interns worked on this summer at Vertica. Projects ranging from improving video game design to building an application for sorting through the ever growing emails in our inboxes. These projects are great examples of how students are training to solve and pose new problems using big data and real-time analytics - thank you Matt & Mark Fay and Alex Leblang for your excellent posts.

As we grow Vertica by adding top notch talent we are excited to see how universities continue to innovate to train the workforce we depend on. For example, Stanford University is offering introductory courses on line for intro to databases, natural language processing, machine learning. We are also seeing an increased interest from universities in updating their curriculum to include classes for analytical thinking to help train leaders to ask better questions of the newly available data. Other universities are leading by example, implementing Big Data solutions of their own to improve retention, and graduation rates with sophisticated data analytics.

The website Online Degrees.org recently posted an infographic that provides a great summary of how Big Data is impacting campus life and the college experience, which we’ve posted below. There’s no doubt that Big Data is having a tremendous impact on the college experience – and that our college interns have had a hugely important impact on us here at Vertica. We wish them – and all – students well in the academic year ahead, and if you’re interested in learning more about Vertica’s internship programs or current job opportunities we would love to hear from you!

To see the infographic, click the “Read More >>” link below!

(more…)

Get Started With Vertica Today

Subscribe to Vertica