Use phone as controller

[FluorescentHallucinogen]

Is it possible to use smartphone that has a gyroscope as controller?

[Utopiah]

Maybe using https://github.com/ryanbetts/dayframe but that would need a good rework of https://github.com/aframevr/a-painter/blob/master/src/components/paint-controls.js

[FluorescentHallucinogen]

Any progress?

[FluorescentHallucinogen]

• Device Orientation (https://www.chromestatus.com/feature/5874690627207168)
• Device Motion (https://www.chromestatus.com/feature/5556931766779904)

There also exist the newer APIs:

• Motion Sensors APIs based on Generic Sensor API (https://www.chromestatus.com/feature/5698781827825664)

[Utopiah]

There probably won't be any progress except if you develop this since A-painter was done solely with roomscale and 6DoF controllers in mind.

[Utopiah]

Alternatively it would also be possible to use a Tango phone as a 6DoF controller, much easier to do now that https://github.com/googlevr/chromium-webar is public.

[Chovin]

I'd very much love to put work into this. Even if support for most phones isn't that great and we end up painting with the little sensors available on mobile browsers nowadays. Maybe we could use https://github.com/jeromeetienne/AR.js or maybe https://trackingjs.com/ as a frame of reference for the phone's position since it seems phone rotation might be the most supported piece of information we can pull from it.

If anyone wants to work on this, please let me know. I would be glad to offer some manpower. If nobody picks it up once I get some more time, I'd love to start on it myself.

Does anybody have any advice on where we could start looking to work on this?

[Utopiah]

@Chovin you might want to test A-painter XR first cf https://blog.mozvr.com/responsive-webxr-a-painter-xr/ because for iOS at least it seems to be doing roughly what you are suggesting.