Example: http://www.ebay.com/itm/ALTERA-FPGA-Cyslonell-EP2C5T144-Mini...
This uses the EP2C5T144. Some basic getting started info here: http://www.leonheller.com/FPGA/FPGA.html [Leon Heller]
You can run a free copy of Quartus and use it to run Verilog / VHDL cpus, or anything else you want to do.
Same applies to the Xilinx FPGAs.
A really cool example project: http://excamera.com/sphinx/fpga-j1.html
I would not worry about vendor lock-in for now -- there are some quite affordable dev boards (like the Arty (http://store.digilentinc.com/arty-a7-artix-7-fpga-developmen...) I've mentioned elsewhere), and no matter what you pick there's a ton of tooling. The concepts from the tools will translate between vendors, though, even if the commands and exact flows change.
Xcell is the name of Xilinx's self-published journal(s), and it's free. Here's the Xcell portal:
http://www.xilinx.com/about/xcell-publications.html
Here's a short article published in Xcell by Niklaus Wirth after he designed and prototyped a RISC CPU on a Xilinx FPGA:
https://issuu.com/xcelljournal/docs/xcell_journal_issue_91/3...
And finally, it's worth noting that the most recent post on the Xcell blog is one titled "Found! A great introduction to FPGAs", which was written just a couple days ago and is a glowing recommendation for the textbook "Digital System Design with FPGA: Implementation Using Verilog and VHDL".
https://forums.xilinx.com/t5/Xcell-Daily-Blog/Found-A-great-...
That said, for a novice there are no significant differences in features between Altera and Xilinx.
The place where you might see problems is mostly in simulation, where the big three tool vendors support different language features in SystemVerilog and VHDL-2008. Again, this is not likely to be a problem for a hobbyist/novice.
GHDL has good support for VHDL-2008, I don't know how good Icarus supports the corresponding SystemVerilog.
I wouldn't say it's horrible, it's just not open source (mainly because it's mostly a high-end market). You can easily get by with the free versions of the implementation/simulation tools if you're a hobbyist
For someone coming from software programming, that seems very strange. But you get over it.