While Serber's book is good, if you really want to know the technical details about Manhattan/project Y, get a copy of Critical Assembly: A Technical History of Los Alamos during the Oppenheimer Years (1943-45) ISBN 978-0521541176 in paper (can't speak to quality, I have the hard cover). It is quite accessible.
spoiler:
probably the biggest engineering problem was the explosive lens