Aspergillus species (spp.), such as Aspergillus fumigatus (AF), is ubiquitous fungus in our environment and causes severe upper and lower airway disorders. Chronic respiratory diseases (CRDs) are series of chronic diseases of the airways and lungs, such as bronchial asthma, chronic obstructive pulmonary disease (COPD), and pulmonary fibrosis. However, the relevance between Aspergillus spp. and CRDs is still not clear. Therefore, we examined 160 Aspergillus spp. isolated samples from January 2012 to December 2014 in our hospital. The samples included sputum, sucking sputum, bronchoalveolar lavage (BAL) fluid, pleural effusion, nasal discharge, and ear discharge. Based on isolation from the samples, we then grouped AF and non-AF to retrospectively analyze the clinical features of each group and clarified the relationships between Aspergillus spp. and CRDs. The patients' characteristics of AF group were older (p < 0.001), male dominant (p = 0.03), higher rate of inpatient (p < 0.001), had comorbidity of diabetes mellitus (p = 0.006), and their isolated Aspergillus was pathogenic (p < 0.001). Importantly, the manifestation of CRD was more frequent in AF group than in non-AF group (p < 0.001). Among CRDs, COPD and lung fibrosis were more evident in AF group than non-AF group (COPD; p = 0.03 and lung fibrosis; p < 0.001). Finally, CRD comorbid patients in AF group showed lower pulmonary functions than non-AF group (%FEV1; p = 0.03 and %FVC; p = 0.051). In conclusion, AF may give an impact on pulmonary functions, thereby lead to pathogenesis of CRDs.