agent-browser uses playwright so it struggles with things like cross-origin-iframes - on the other hand, browser harness uses raw cdp, which is unrestrictive. It's discussed in this blog post!
https://browser-use.com/posts/bitter-lesson-agent-harnesses