Yes, in some contexts, they're synonymous. However, they tend to have different connotations. Inexpensive usually implies low in cost, but of reasonable quality. Cheap tends to imply low in cost, and low quality. For example, someone cheaping out on a part.