A sharp rise in students without middle school-level math skills is raising alarms among educators and policymakers.