Names of departments are capitalized only when using the full formal name, or when the department name is the proper name of a nationality, people, or race. (Do not abbreviate to “dept.”)
Department of Biology; the biology department;
Department of English; the English department