GraphQL Bulk Operation mutation file size limit

[cloudev0]

Does the import api have a file size limit? I'm trying to upload a ~36mb file, and I keep getting broken pipe in ruby (Faraday) and curl almost instantly when I initiate the multipart form POST request. Any advice?

Thanks in advance.

[alex0000]

I have the same problem, does somebody have an answer ? (seem to be S3 limitation)

<?xml version="1.0" encoding="UTF-8"?>
<Error>
    <Code>EntityTooLarge</Code>
    <Message>Your proposed upload exceeds the maximum allowed size</Message>
    <ProposedSize>20975508</ProposedSize>
    <MaxSizeAllowed>20971520</MaxSizeAllowed>
    <RequestId>N5FTYTNP6MPP1VB9</RequestId>
    <HostId>Nlu1xkUPTWKP345Uma79b2hQzFzqDJ3fBrZN7g1iM552PHuf0uif/gM4Cqg3UxXp7KVi+b5AIvI=</HostId>
</Error>

[cloudev0]

I ended up rotating files when writing the mutation data (think log rotation, with each file having 20mb max), then chain upload the files. Upload first file. Wait for Webhook. When Webhook comes, respond and upload the next file and so on.

[Wilhelm_Uschtr1]

@cloudev0 If I may ask, what's the average import speed/rate you get doing that?

[cloudev0]

Sorry for the late reply, I can't give a specific metric since it really depends on the kind of data. But for a specific example,
a chained mutation that manages to update price, cost, compare at price, description, tags, weight and 1 product level metafield of around 12k variants, that had the size of ~21.2MB (so 2 bulk operations), took around 11 minutes (started at 2024-05-06T13:06:40+03:00 and completed at2024-05-06T13:17:30+03:00 according to Shopify webhook)

[Wilhelm_Uschtr1]

Awesome, thanks for the late reply! 🙂

[GrahamS · Accepted solution]

Hey @cloudev0 

At the moment, the file size limit is 20 megabytes for bulk mutations. We're going to review the documentation to have this made more clear in the future.

Best,

[DavidT]

So how are we supposed to get around this problem without having to do multiple bulk mutations???