I'm curious for those who have actually tried it, what they think of the performance. A lot of the threads here are just talking about the country-limited rollout.
https://reddit.com/r/Bard/comments/11xja9x/i_have_access_tak...
Bard 2 week trip to Japan
Day 1: Fly from your home city to Narita International Airport (NRT) in Tokyo. Upon arrival, take the Narita Express train to Shinjuku Station. Check in to your hotel in Shinjuku.
Day 2: Explore Shinjuku. Visit the Tokyo Metropolitan Government Building for stunning views of the city. Explore the Shinjuku Gyoen National Garden, a beautiful park with traditional Japanese gardens, a greenhouse, and a pond.
Day 3: Take a day trip to Hakone, a town in the mountains about an hour from Tokyo. Visit Lake Ashi, a beautiful lake surrounded by mountains. Take a boat ride on the lake and enjoy the views. Visit Hakone Open-Air Museum, an outdoor museum with sculptures and other works of art.
Day 4: Take a Shinkansen bullet train from Tokyo to Kyoto. Check in to your hotel in Kyoto.
Day 5: Explore Kyoto. Visit the Kiyomizu-dera Temple, a UNESCO World Heritage Site. Visit the Arashiyama Bamboo Forest, a beautiful bamboo forest.
Day 6: Take a day trip to Nara, a city about an hour from Kyoto. Visit Todai-ji Temple, a Buddhist temple that houses a giant statue of Buddha. Visit Nara Park, a park that is home to over 1,200 wild deer.
Day 7: Take a Shinkansen bullet train from Kyoto to Osaka. Check in to your hotel in Osaka.
Day 8: Explore Osaka. Visit the Dotombori district, a popular tourist destination with bright lights and many restaurants. Visit the Osaka Aquarium Kaiyukan, one of the largest aquariums in Japan.
Day 9: Take a day trip to Hiroshima, a city about two hours from Osaka. Visit the Hiroshima Peace Memorial Park, a park dedicated to the victims of the atomic bombing of Hiroshima. Visit the Hiroshima Peace Memorial Museum, a museum that tells the story of the atomic bombing of Hiroshima.
Day 10: Take a Shinkansen bullet train from Osaka to Tokyo. Check in to your hotel in Tokyo.
Day 11: Explore Tokyo. Visit the Shibuya Crossing, one of the busiest intersections in the world. Visit the Meiji Jingu Shrine, a Shinto shrine dedicated to the Emperor Meiji and Empress Shoken.
Day 12: Take a day trip to Kamakura, a city about an hour from Tokyo. Visit the Tsurugaoka Hachiman-gū Shrine, a Shinto shrine dedicated to the god of war. Visit the Great Buddha of Kamakura, a giant bronze statue of Buddha.
Day 13: Fly from Narita International Airport (NRT) back to your home city.
----------------------------------
ChatGPT 2 week trip to Japan
Day 1-3: Tokyo Arrive in Tokyo and spend the first few days exploring the city. Visit popular tourist attractions such as Tokyo Tower, Sensoji Temple, Meiji Shrine, and Shibuya Crossing. Spend a day exploring the trendy neighborhoods of Harajuku and Omotesando, and visit the famous Tsukiji Fish Market.
Day 4-6: Mount Fuji Take a day trip to Mount Fuji, Japan's highest mountain, and spend the night in the nearby Fuji Five Lakes area. Enjoy stunning views of the mountain and surrounding scenery, visit a traditional Japanese onsen (hot springs), and explore the picturesque towns of Kawaguchiko and Hakone.
Day 7-10: Kyoto Take a bullet train to Kyoto, Japan's ancient capital. Spend your days exploring the city's many temples and shrines, such as Kiyomizu-dera, Fushimi Inari Shrine, and the Golden Pavilion. Visit the historic districts of Gion and Higashiyama, and take a day trip to Nara, home to some of Japan's oldest and largest temples.
Day 11-13: Hiroshima and Miyajima Take a train to Hiroshima and spend the day visiting the Peace Memorial Park and Museum, which commemorates the atomic bombing of the city in 1945. From Hiroshima, take a short ferry ride to Miyajima Island, known for its famous Itsukushima Shrine and its iconic torii gate in the sea.
Day 14: Osaka Take a train to Osaka, Japan's third-largest city, and spend the day exploring its many attractions, such as the Osaka Castle, Dotonbori district, and Universal Studios Japan.
Day 15: Departure Depart from Japan from Kansai International Airport in Osaka.
Unless the facts about Japan are just wrong, which I don't have the expertise to judge, it seems about the same?
Bard's has a few small oddities -- the Shinkansen from Kyoto to Osaka takes less than an hour, so Day 7's underscheduled -- but those are nothing compared to ChatGPT's (days 11-13 are underscheduled; Osaka's usually bundled with Kyoto and is overscheduled anyway; dunno why a "day trip" to Mt. Fuji takes 3 days).
Additional prompting to tell it to correct the output doesn't seem to have the same effect as it does in the OpenAI models.
Arguably there's an issue in the Bard one in that it splits the Tokyo portion in two and has you return there to fly home, but also some people might prefer this to have a round-trip ticket to the same airport.
Maybe it's my lack of knowledge about Japan, but I'm just not seeing a difference between the two in terms of logical reasoning.
What makes the answer from ChatGPT better?
But the first thought that jumped to my mind was you meant "performance" as in "quality" -> the believability/humanity of the "performance" of the chatbot.
It was a silly misunderstanding on my part but I suspect it's indicative of an important point: This product war won't be won on latency - people are happy to wait seconds for most of the scenarios, and possibly even MINUTES for many of them.
In terms of quality, it's mediocre. I find it bland and boring, and if you try to let it write poems, raps or anything with a deeper understanding it fails more than chatgpt would.
I disagree though, absolute speed is going to be important for the chatbot that wants to disrupt the search space. I could see Google Assistent relying on it more for information, and it would be near instant.
For writing large texts or digesting many other documents it will probably matter less, yeah.