--- You USE ultimately to indicate that something is the final result of a series of events.
The discovery may ultimately lead to the development of new contraceptives.
The rebels hoped to create bad feeling and ultimately war between Spain and the United States.
You also USE ultimately when you are drawing attention to a basic fact about a situation.
Ultimately, the problems are not scientific but moral.
It is ultimately the fault of the universities.
You do NOT use ultimately to say that something has been happening since a short time ago.
You do not say, for example, 'Ultimately I have been feeling rather unwell'. You say 'I have been feeling rather unwell lately'.
See recently - newly - latelyhttp://www.thefreedictionary.com/ultimately