Entry points that consume their input have unexpected runtime impact in futhark bench

[athas]

futhark bench re-initialises consumed entry point arguments (as it should), but for some reason there can be significant performance impact. NW is affected. We need to figure out what is going on, as this affects @Munksgaard's work in particular.

[athas]

It's some NVIDIA thing; doesn't happen on the MI100. Who knows, maybe it demand-pages the memory onto the device during the first execution. This does cool my desire to work on it somewhat.

[coancea]

Lazy models are a nuisance

---

From: Troels Henriksen @.***> Sent: Saturday, February 5, 2022 4:45:15 PM To: diku-dk/futhark Cc: Subscribed Subject: Re: [diku-dk/futhark] Entry points that consume their input has unexpected runtime impact in futhark bench (Issue #1582)

It's some NVIDIA thing. Who knows, maybe it demand-pages the memory onto the device during the first execution. This does cool my desire to work on it somewhat.

— Reply to this email directly, view it on GitHubhttps://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fdiku-dk%2Ffuthark%2Fissues%2F1582%23issuecomment-1030647371&data=04%7C01%7Ccosmin.oancea%40di.ku.dk%7C4f62fba687b047c9362808d9e8be81c7%7Ca3927f91cda14696af898c9f1ceffa91%7C0%7C0%7C637796727189187900%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=Gq33h1zfhi9uoo4h4wqDoRpZDhLTMnq%2FO4%2Fnky9LV%2F0%3D&reserved=0, or unsubscribehttps://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAAJLGCYPXU5LU2K54WIDPT3UZVAYXANCNFSM5NPBMSJA&data=04%7C01%7Ccosmin.oancea%40di.ku.dk%7C4f62fba687b047c9362808d9e8be81c7%7Ca3927f91cda14696af898c9f1ceffa91%7C0%7C0%7C637796727189187900%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=OI%2B0IcUgcFFIfiePLlYq7PhycRODWtPOxVAxfEpjEUg%3D&reserved=0. Triage notifications on the go with GitHub Mobile for iOShttps://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fapps.apple.com%2Fapp%2Fapple-store%2Fid1477376905%3Fct%3Dnotification-email%26mt%3D8%26pt%3D524675&data=04%7C01%7Ccosmin.oancea%40di.ku.dk%7C4f62fba687b047c9362808d9e8be81c7%7Ca3927f91cda14696af898c9f1ceffa91%7C0%7C0%7C637796727189187900%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=%2FXiMGP5xt6eCB239XpGMj6efmb7QIgPwkx%2BeAcsENdU%3D&reserved=0 or Androidhttps://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fplay.google.com%2Fstore%2Fapps%2Fdetails%3Fid%3Dcom.github.android%26referrer%3Dutm_campaign%253Dnotification-email%2526utm_medium%253Demail%2526utm_source%253Dgithub&data=04%7C01%7Ccosmin.oancea%40di.ku.dk%7C4f62fba687b047c9362808d9e8be81c7%7Ca3927f91cda14696af898c9f1ceffa91%7C0%7C0%7C637796727189187900%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=bDwswGyU7MFAh6%2F3ZKP6z%2BeM1%2FgChcbvxXHMaMyyb60%3D&reserved=0. You are receiving this because you are subscribed to this thread.Message ID: @.***>

[athas]

I don't think this is really about Futhark.