Will archived Mailchimp members upsert Salesforce records?

No. Archived Mailchimp members are synced and stored as Mailchimp Member records in Salesforce, but they are excluded from the processing that creates or updates Salesforce records (Mailchimp to Salesforce mappings).