Parshaman-
If your only requirement is “something small” to take notes on, the cheapest computer sold should meet your needs.
Even a netbook may be good enough for your intended usage, and I just saw a new one on sale at Best Buy for $200.
As far as a program to use for taking notes, the “Open Office” suite is free and it includes a full word processor.