I tried recreating this and you’re right, start date won’t set from a date field within the record. I also tried setting the end date, thinking it required both values, but that also didn’t work.
I would suggest reaching out to support to see if this is a known bug.