We came across an Excel installation that was extremely slow to start. We tried Excel’s safe mode and it was lightning fast, like it should be. Since there were no Excel add-ins on this machine, the fix was simple. Rename the toolbar and quick access bar files.
For more info, check out this MS knowledgebase file here.