Not necessarily. If a woman converts to Judaism; promising to keep the 613 mitzvot and does so sufficiently as a frum Jew, and has children; then her children are Jewish.
If she happens to go OTD the following year, are her children no longer Jewish? Does someone come in and strip away their neshamot?