if you look straight down into the hole in the baseboard, you'll see (if I recall right) an X or + shaped thingy. That's said dighole mentioned in above posts. Delete that with the delete tool in the buildings tab, then magically the hole in your baseboard will be closed. 
.
.