The aim of this study is to determine the relationship between leisure time physical activity (LTPA) and non-leisure time physical activity (NLTPA) on mortality among the elderly in Taiwan. This is a prospective observational cohort study. We analyzed the mortality data from a cohort of 876 non-institutionalized community-dwelling men and women aged 65 years or over, who were recruited by stratified clustering random sampling from Tainan city and participated in the 1996 Elderly Medication Survey. Information about activities and other variables were collected by structured interviews at baseline in the participants' home. The Cox proportional hazards model and crude death rate were applied to estimate mortality risk. Among the 876 participants, 312 died during the follow-up period (1996-2004). In the unadjusted Cox regression model, subjects aged over 75, having difficulty in carrying out activities of daily living (ADLs), a BMI less than 18.5, a history of diabetes mellitus or stroke, without LTPA or being inactive in NLTPA, were found to have a higher risk of eight-year mortality. With the adjustment for age, gender, education level, habitual smoking and drinking, living status, BMI and medical history, the mortality was found to be higher among the sedentary subjects, either defined by lack of LTPA or NLTPA, with the hazard ratio of 1.27 (95% confidence interval [CI] = 0.97-1.66) and 1.45 (95% CI = 1.07-1.97), respectively. Furthermore, when both LTPA and NLTPA were put into the model simultaneously, NLTPA (HR = 1.40; 95% CI = 1.03-1.91) but not LTPA (HR = 1.21, 95% CI = 0.92-1.59) significantly predicted mortality during eight-year follow-up. In addition, subjects who were actively engaged in NLTPA had a lower mortality risk especially in subjects without performing LTPA. NLTPA is an independent predictor of longevity among older people in Taiwan. A physically active lifestyle, especially engaged in NLTPA, is associated with lower mortality risk in the elderly population. We thus suggest that encouraging older people to keep on engaging in customary NLTPA is good for their health.