importcjj/nipper

A Rust crate for manipulating HTML with CSS selectors

Nipper

A crate for manipulating HTML with Rust.

Nipper based on HTML crate html5ever and the CSS selector crate selectors. You can use the jQuery-like syntax to query and manipulate an HTML document quickly. Not only can query, but also can modify.

Example

Extract the hacker news.

use nipper::Document;

fn main() {
    let html = include_str!("../test-pages/hacker_news.html");
    let document = Document::from(html);

    document.select("tr.athing").iter().for_each(|athing| {
        let title = athing.select(".title a");
        let href = athing.select(".storylink");
        println!("{}", title.text());
        println!("{}", href.attr("href").unwrap());
        println!();
    });
}

Readability.

examples/readability.rs

Related projects

• html5ever
• selectors
• goquery
• scraper
• select.rs

License

Licensed under either of

• Apache License, Version 2.0 (LICENSE-APACHE or http://www.apache.org/licenses/LICENSE-2.0)
• MIT license (LICENSE-MIT or http://opensource.org/licenses/MIT)

at your option.

Contribution

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in the work by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.

nipper's Issues

Thank you!

I just wanted to say thank you for putting this project together. I looked through crates.io & lib.rs for a fair amount of time, and I knew there had to be a project out there that just worked, and had a mutation interface. And you have a CSS selector based interface. Doesn't get better than this!

Feel free to close this issue once you're sick of looking at it :).

0.1.9 release

Hey there. Anything in particular blocking the 0.1.9 release? I recently forked the project to add a few needed methods, then I found that the methods already exist as of 0.1.9, but have not yet been released.

Just wanted to touch base and see if there is any particular reason for this, or if it is just due to timing (which I totally understand).

Cheers

More methods to handle nodes' class

• has_class
• add_class
• remove_class

Question on creating new nodes

Hi, I haven't looked at this project too deeply so excuse me if this question sounds ignorant. Is it possible to make a new Node and is it possible to make it from an HTML string?

Fix `append_with_selection`

Function append_with_selection will cause panic when the given selection object comes from another dom tree.

Add an ID field to every dom tree.

Improve the documentation.

Adjust project structure

Unicode miss conversion ?

What's happen?

let html_document = Document::from(data.as_str());

    let price = match html_document
        .select(product_data.price_selector.as_str())
        .iter()
        .next()
    {
        None => {
            println!("Unable to retrieve price element");
            "".to_string()
        }
        Some(price) => price.text().to_string(),

Updated dependencies

The project was using some outdated dependencies, I create a draft pull request (#22) that updates every dependency expect cssparser. There are no breaking changes but the cssparser update is blocked by servo/servo#28368 first,

Unicode miss conversion ?