Check out the exact same seed and prompt and cfg_scale, but with the steps aka iteration number at 100 (50 in general feels way too low, even for the samplers that are kinda good with low iteration numbers).
https://pasteboard.co/I6yXg5mZip6D.png
Obvious glitchiness in the face. Below is the same one, but with a k_euler_a sampler (I don't use k_lms, mostly k_euler_a or k_dpm_2_a) + 100 iterations.
https://pasteboard.co/xaTJiN6eVhm2.png
Less glitchiness, but Joe looks more caricature-like, than real. And also, not super quite like Joe. Let's try the same, but at 150 iterations and set the CFG at 10.
https://pasteboard.co/a9OigPXS9Ky1.png
Not much different in terms of realism, but the person looks distinctly way more like Joe. Let's up the iteration number to 200.
https://pasteboard.co/ey0ZzC110CrK.png
We got a bit closer to what we wanted. Faces are a bit of a difficult thing to do, but i think we can figure it out. Overall, it feels a bit "wobbly". I noticed that it tends to be beneficial to decrease the CFG as you increase iteration number, if you want photos to be more photorealistic. Let's set it to 6, and the iteration at 200.
https://pasteboard.co/na1fH54LkqO2.png
I would say this looks pretty good, but I think we can do better. The important part is imo the prompt, and I think we can edit yours to get a bit better results. Here is the result for "portrait of Joe Biden in oval office, dslr" with 200 iterations, CFG at 6, and k_euler_a sampler.
https://pasteboard.co/noHbMgxhLU4s.png
That one was probably my favorite (or maybe it was the one before).
Overall, you can play with this almost infinitely. Adding different words to the prompt in different spots can yield pretty different results. And that's not even mentioning all the parameters one can tune.