Open-sourcing Vessel: a high-level Ruby web crawling framework
The Californer/10241986

SAN FRANCISCO - Californer -- Vessel is a fast, open-source, high-level, web crawling and scraping framework for Ruby, built on top of Ferrum — a minimal-dependency pure-Ruby driver for running headless Google Chrome instances.

Why would you need a web crawler? Perhaps you're building a search engine for an intranet or a group of public-facing websites, or just need to mirror a website with finer-grained control than tools such as wget offer.

The best way to demonstrate Vessel's capabilities is with an example. Don't worry, just because of what Vessel's capable of, it doesn't mean that it's hard to use.

You can see from the example how easy it is to scrape — extract structured data from typically-unstructured web pages — using Ferrum's DOM methods.

More on The Californer

• Long Beach Parks, Recreation and Marine's Homeland Cultural Center Presents DanceFest at Cesar Chavez Park Amphitheater on August 16
• Sisu, a Portrait of Grit, Connection and Triumph, Premieres on Documentary Showcase
• New Liz Taylor Book Coming Soon: Chasing Elizabeth Taylor
• City of Long Beach Experienced a 4% Decrease in Fireworks-Related Reports on July 4
• The Blue Luna Encourages Local Schools to Take Steps to Enhance Safety for Students and Staff

In fact, with Vessel and Ferrum, you can crawl, parse, extract, and transform web content with so little effort, you'll wonder why you ever had to do it any other way before!

Ferrum + Crawling = Vessel

If you're considering using Ferrum to perform some web crawling, then look no further than Vessel a Ferrum-based crawling framework for Ruby.

Learn how you can use Vessel framework in your project.

https://evrone.com/vessel-framework
https://evrone.com/ruby
https://evrone.com/ferrum-ruby-chrome-driver