The Difference Between Retirement Age And Stop Work Ages. Your retirement age is the age at which you begin receiving Social Security retirement benefits.. Your stop work age is the age at which you leave the labor force and no longer work. It can affect the amount of your Social Security retirement benefits. Your retirement benefit is based on your highest 35 years of earnings and your age ...