Attribute selectors vs \n in values

Hi! Thanks for the powerful library.

I use it via BeautifulSoup, and I find out this behavior:

from bs4 import BeautifulSoup

soup = BeautifulSoup("<p><span title='foo bar'>foo1</span><span title='foo\nbar'>foo1</span></p>", 'html.parser')
print(*soup.select('span[title*="bar"]'))

I expected this to print both spans, but the actual output is

<span title="foo bar">foo1</span>

It seems that *= considers only the first line of multi-line attribute:

print(*soup.select('span[title*="foo"]'))

prints this:

<span title="foo bar">foo1</span> <span title="foo
bar">foo1</span>

Is there some bug, or some conscious limitation, or \n in attribute values is against the standard? Thanks!

[facelessuser]

Wow. I don’t know what to say. To handle such a peculiar request so fast and gracious—it is absolutely awesome 😍 Thank you!

It’s actually not so peculiar. Yes, it is a bit odd to use newlines in attributes, but Soup Sieve’s goal is to match real-world CSS selector behavior, as much as is practical and possible in the scraping environment. Ideally, we’d like to limit surprises and have things operate as close as possible to what people experience using selectors in real browsers. Real-world browsers handle such cases, so we should too 🙂 .

Before I wrote Soup Sieve, BeautifulSoup’s selector behavior was quite limited and very quirky. Now, you can copy in most selectors and they should work pretty much as expected meaning you don’t have to think so hard about what this selector implementation supports and what it doesn’t or what it does differently.

I plan on cutting a release later today, so you should be able to pick the fix up soon.

[facelessuser]

@gir-bot remove S: triage @gir-bot add T: bug, S: confirmed