No, you can use the Dependent Care FSA to cover expenses for anyone who watches your children while you and your spouse are working. It can even be a family member, as long as that person is not your tax dependent. The only rules that apply are that you must provide the Social Security number or Tax ID of your daycare provider, and that person must claim the income.
