If human population stops rising or decreases, what will be the negative effects for people?

From the environmental standpoint shrinking of human population is often quoted to have desirable effects, and that's reasonable. But from the point of view of our daily lives and functioning of the human society, what negatives could we then expect? (I mean a soft decline due to lower birth rates, not some abrupt events.)

For example, with smaller population fewer music albums could be made every year than some time before, and people would maybe feel less inspired and satisfied. Less scientific research, less choices for relationships... and maybe other things? Would being more technically advanced compensate for the issues? Won't we feel ourselves in oblivion and romanticize the "numerous" past?