Read through Lincoln's correspondence for, say, the last two months of his life. And public remarks from the same period. They refute General Butler's single-sourced anecdote (sourced by himself, only -- Butler was an interesting character, to be sure, but a notoriously unreliable witness).
See also: quod.lib.umich.edu/j/jala/2629860.0029.103/--benjamin-butlers-colonization-testimony-reevaluated?rgn=main;view=fulltext
"[W]hen Lincoln accepted freedmen as soldiers on January 1, 1863, he guaranteed a biracial future for the country because no President could ask a man to fight for his country and then tell him it was no longer his country. By the end of his administration Lincoln definitely had 'sloughed off' the idea."
It's not a question of my liking it or not liking it. It's a question of the hard evidence -- which I'm not going to dig up and post here. Do your own research.
All of Lincoln's correspondence and public remarks are available online, and if you read through those remarks, they refute any notion of his holding, as a matter of public policy, colonization of negroes, at any point during the initial phases of Reconstruction through his death.
The only time during his presidency when he made such a remark publicly was in 1862, when he met with a delegation of black Washingtonians, as described here: housedivided.dickinson.edu/sites/emancipation/files/2012/07/Masur-article.pdf
I'm not denying that Lincoln *had* the idea (probably traceable to his idolization of Henry Clay), but he *never* advanced it as a matter of public policy in the last years of his presidency, which are very well-documented.
The one exception to this being General Butler's account of alleged remarks for which Butler was the sole witness, and which are contradicted by other, public remarks, and private correspondence that is now a part of the public record.