aggregate icon indicating copy to clipboard operation
aggregate copied to clipboard

Data of a repeat group inside a repeat group does not export to Fusion Table

Open getodk-bot opened this issue 7 years ago • 6 comments

Issue by yanokwa Wednesday Dec 28, 2016 at 15:09 GMT Originally opened as https://github.com/opendatakit/opendatakit/issues/1264 (2 comment(s))


If you have a repeat group B inside a repeat group A, and you submit that data to Aggregate, the submission works fine. If you publish that data to Fusion Tables, the tables are created, but the sub repeat group (B)'s tables will be empty.

To replicate this issue, I used this [fusion-test.xlsx] form (https://github.com/opendatakit/opendatakit/files/675712/fusion-test.xlsx) to generate a sample submission.

<?xml version='1.0' ?>
<fusion-test id="fusion-test">
	<repeat_a>
		<text_a>a1</text_a>
		<repeat_b>
			<text_b>a1b1</text_b>
		</repeat_b>
		<repeat_b>
			<text_b>a1b2</text_b>
		</repeat_b>
		<repeat_b>
			<text_b>a1b3</text_b>
		</repeat_b>
	</repeat_a>
	<repeat_a>
		<text_a>a2</text_a>
		<repeat_b>
			<text_b>a2b1</text_b>
		</repeat_b>
		<repeat_b>
			<text_b>a2b2</text_b>
		</repeat_b>
		<repeat_b>
			<text_b>a2b3</text_b>
		</repeat_b>
		<repeat_b>
			<text_b>a2b4</text_b>
		</repeat_b>
	</repeat_a>
	<repeat_a>
		<text_a>a3</text_a>
	</repeat_a>
	<meta>
		<instanceID>uuid:43a8623f-1a00-4174-8bb2-712d9e048b43</instanceID>
	</meta>
</fusion-test>

When this submission is sent to Aggregate, the right things happen.

Aggregate, Repeat A ag_a

Aggregate, Repeat A1B ag_a1_b

Aggregate, Repeat A2B ag_a2_b

When this submission is sent to Fusion Tables, the sub repeat (B) shows up as empty.

Fusion Table, Repeat A ft_a

Fusion Table, Repeat B ft_b

getodk-bot avatar Aug 12 '17 02:08 getodk-bot

Comment by mitchellsundt Tuesday Jan 03, 2017 at 21:13 GMT


This was an intentional limitation of repeat-group support in the publishers. I think Waylon coded these in a few days; constructing the top-level view was becoming insanely difficult.

Repeat group support is also broken in significant ways in Sheets.

getodk-bot avatar Aug 12 '17 02:08 getodk-bot

Comment by yanokwa Tuesday Jan 03, 2017 at 23:48 GMT


@wbrunette What approach would you take to fix this?

getodk-bot avatar Aug 12 '17 02:08 getodk-bot

This message was created automatically by mail delivery software.

A message that you sent could not be delivered to one or more of its recipients. This is a temporary error. The following address(es) deferred:

[email protected] Domain beorse.net has exceeded the max emails per hour (292/250 (116%)) allowed. Message will be reattempted later

------- This is a copy of the message, including all the headers. ------ Received: from github-smtp2-ext3.iad.github.net ([192.30.252.194]:43187 helo=github-smtp2b-ext-cp1-prd.iad.github.net) by hp159.hostpapa.com with esmtps (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.89) (envelope-from [email protected]) id 1dgMDZ-000f0z-76 for [email protected]; Fri, 11 Aug 2017 22:32:01 -0400 Date: Fri, 11 Aug 2017 19:31:21 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=github.com; s=pf2014; t=1502505081; bh=E4x5HxG9enD3Im/RqfftsuUawzFuFgypf8SsrXsuUKE=; h=From:Reply-To:To:Cc:In-Reply-To:References:Subject:List-ID: List-Archive:List-Post:List-Unsubscribe:From; b=1M/h2Ly5amKLaXV6UYVgSqJCfwSCrS7snuy04vsYab+s3C0eaVvrKeWDrLqwCrwtn c9vHRl/9huMEJBuj3qlHTompmLEdcoHBYMjb4FIk25rmzCg6CFnoD+F5IzRdYeqwNR sXuGcwzeCgMyrGLoXQAL+Oxna4wv1MN99ivKRsfk= From: Open Data Kit [email protected] Reply-To: opendatakit/aggregate [email protected] To: opendatakit/aggregate [email protected] Cc: Subscribed [email protected] Message-ID: opendatakit/aggregate/issues/83/[email protected] In-Reply-To: opendatakit/aggregate/issues/[email protected] References: opendatakit/aggregate/issues/[email protected] Subject: Re: [opendatakit/aggregate] Data of a repeat group inside a repeat group does not export to Fusion Table (#83) Mime-Version: 1.0 Content-Type: multipart/alternative; boundary="--==_mimepart_598e687996202_5fef3f82a7db5c2c98349"; charset=UTF-8 Content-Transfer-Encoding: 7bit Precedence: list X-GitHub-Sender: opendatakit-bot X-GitHub-Recipient: jbeorse X-GitHub-Reason: subscribed List-ID: opendatakit/aggregate <aggregate.opendatakit.github.com> List-Archive: https://github.com/opendatakit/aggregate List-Post: mailto:[email protected] List-Unsubscribe: mailto:unsub+000519affd5e3ba97e13302396903e03cf1ee088e6f042bc92cf0000000115a62a7992a169ce0ee362ba@reply.github.com, https://github.com/notifications/unsubscribe/AAUZr_aH7EnckwtiLlhUvfcNEDleb7mtks5sXQ55gaJpZM4O1SR3 X-Auto-Response-Suppress: All X-GitHub-Recipient-Address: [email protected]

----==_mimepart_598e687996202_5fef3f82a7db5c2c98349 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit

Comment by yanokwa Tuesday Jan 03, 2017 at 23:48 GMT


@wbrunette What approach would you take to fix this?

-- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/opendatakit/aggregate/issues/83#issuecomment-321952097 ----==_mimepart_598e687996202_5fef3f82a7db5c2c98349 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

Comment by yanokwa
Tuesday Jan 03, 2017 at 23:48 GMT


@wbrun= ette What approach would you take to fix this?

&m= dash;
You are receiving this because you are subscribed to this thre= ad.
Reply to this email directly, view it on GitHub= , or mute the thread.

=

----==_mimepart_598e687996202_5fef3f82a7db5c2c98349--

jbeorse avatar Aug 12 '17 02:08 jbeorse

This message was created automatically by mail delivery software.

A message that you sent could not be delivered to one or more of its recipients. This is a temporary error. The following address(es) deferred:

[email protected] Domain beorse.net has exceeded the max emails per hour (290/250 (115%)) allowed. Message will be reattempted later

------- This is a copy of the message, including all the headers. ------ ------ The body of the message is 8391 characters long; only the first ------ 5000 or so are included here. Received: from o3.sgmail.github.com ([192.254.112.98]:38388) by hp159.hostpapa.com with esmtps (TLSv1.2:ECDHE-RSA-AES128-GCM-SHA256:128) (Exim 4.89) (envelope-from [email protected]) id 1dgMDX-000ezW-7V for [email protected]; Fri, 11 Aug 2017 22:31:59 -0400 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=github.com; h=from:reply-to:to:cc:subject:mime-version:content-type:content-transfer-encoding:list-id:list-archive:list-post:list-unsubscribe; s=s20150108; bh=F8awQQoR61Ga5WQjxpm0rc+DH3A=; b=jdgDoYvVne8m+HIZ Igy2xNYZyGGJ5m6asccSDkFSEEqys2NfccpLMSv9Wpuj0bCWoxNih14LyrSanbWh +S58Cw1tatIOenh221j3xN93qLMtESoFhUhVYLXY7CG+nJE9uTRlKNSKANsaha4A eXzuazzvX9XoEjt7DVEZZ3hj4as= Received: by filter0947p1mdw1.sendgrid.net with SMTP id filter0947p1mdw1-13369-598E6877-2A 2017-08-12 02:31:19.574825163 +0000 UTC Received: from github-smtp2a-ext-cp1-prd.iad.github.net (github-smtp2a-ext-cp1-prd.iad.github.net [192.30.253.16]) by ismtpd0023p1mdw1.sendgrid.net (SG) with ESMTP id bdyNI7EaSIiV9Kw8oKNwbQ for [email protected]; Sat, 12 Aug 2017 02:31:19.545 +0000 (UTC) Date: Sat, 12 Aug 2017 02:31:19 +0000 (UTC) From: Open Data Kit [email protected] Reply-To: opendatakit/aggregate [email protected] To: opendatakit/aggregate [email protected] Cc: Subscribed [email protected] Message-ID: opendatakit/aggregate/issues/[email protected] Subject: [opendatakit/aggregate] Data of a repeat group inside a repeat group does not export to Fusion Table (#83) Mime-Version: 1.0 Content-Type: multipart/alternative; boundary="--==_mimepart_598e6876eea64_34683fd01df59c2c596ab"; charset=UTF-8 Content-Transfer-Encoding: 7bit Precedence: list X-GitHub-Sender: opendatakit-bot X-GitHub-Recipient: jbeorse X-GitHub-Reason: subscribed List-ID: opendatakit/aggregate <aggregate.opendatakit.github.com> List-Archive: https://github.com/opendatakit/aggregate List-Post: mailto:[email protected] List-Unsubscribe: mailto:unsub+000519af75c2653e4b185d8026c83779cddedf28e3e1678592cf0000000115a62a7692a169ce0ee362ba@reply.github.com, https://github.com/notifications/unsubscribe/AAUZrxDXvOYBZh-i1x1a8pM5tZshNFefks5sXQ52gaJpZM4O1SR3 X-Auto-Response-Suppress: All X-GitHub-Recipient-Address: [email protected] X-SG-EID: JVRD81wLmvjBgNlAmNtibjEbEEhcPGKEESixoxP2c45R9jXrbGJJwPtlCWhpbt3ZQ6q5cPjihSweu+ YOx7wGafmRlBns1fW5GeW0aOsExZiDFBSV515C1GhvppI9Oa11pFk1AYJCjSjWy34sfPlGDwsX8Gsf D55GHZaVotIdwtR25AUF77s+MraglpLE9aMqUX3L69ja2uql7JFFsDPHnsxvpq+uzkoIbdT9KcXeei 0=

----==_mimepart_598e6876eea64_34683fd01df59c2c596ab Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit

Issue by yanokwa Wednesday Dec 28, 2016 at 15:09 GMT Originally opened as https://github.com/opendatakit/opendatakit/issues/1264 (2 comment(s))


If you have a repeat group B inside a repeat group A, and you submit that data to Aggregate, the submission works fine. If you publish that data to Fusion Tables, the tables are created, but the sub repeat group (B)'s tables will be empty.

To replicate this issue, I used this [fusion-test.xlsx] form (https://github.com/opendatakit/opendatakit/files/675712/fusion-test.xlsx) to generate a sample submission.

<?xml version='1.0' ?>
<fusion-test id="fusion-test">
	<repeat_a>
		<text_a>a1</text_a>
		<repeat_b>
			<text_b>a1b1</text_b>
		</repeat_b>
		<repeat_b>
			<text_b>a1b2</text_b>
		</repeat_b>
		<repeat_b>
			<text_b>a1b3</text_b>
		</repeat_b>
	</repeat_a>
	<repeat_a>
		<text_a>a2</text_a>
		<repeat_b>
			<text_b>a2b1</text_b>
		</repeat_b>
		<repeat_b>
			<text_b>a2b2</text_b>
		</repeat_b>
		<repeat_b>
			<text_b>a2b3</text_b>
		</repeat_b>
		<repeat_b>
			<text_b>a2b4</text_b>
		</repeat_b>
	</repeat_a>
	<repeat_a>
		<text_a>a3</text_a>
	</repeat_a>
	<meta>
		<instanceID>uuid:43a8623f-1a00-4174-8bb2-712d9e048b43</instanceID>
	</meta>
</fusion-test>

When this submission is sent to Aggregate, the right things happen.

Aggregate, Repeat A ag_a

Aggregate, Repeat A1B ag_a1_b

Aggregate, Repeat A2B ag_a2_b

When this submission is sent to Fusion Tables, the sub repeat (B) shows up as empty.

Fusion Table, Repeat A ft_a

Fusion Table, Repeat B ft_b

-- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/opendatakit/aggregate/issues/83 ----==_mimepart_598e6876eea64_34683fd01df59c2c596ab Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 7bit

Issue by yanokwa
Wednesday Dec 28, 2016 at 15:09 GMT
Originally opened as opendatakit/opendatakit#1264 (2 comment(s))


If you have a repeat group B inside a repeat group A, and you submit that data to Aggregate, the submission works fine. If you publish that data to Fusion Tables, the tables are created, but the sub repeat group (B)'s tables will be empty.

To replicate this issue, I used this [fusion-test.xlsx] form (https://github.com/opendatakit/opendatakit/files/675712/fusion-test.xlsx) to generate a sample submission.

<?xml version='1.0' ?>
<fusion-test id="fusion-test">
	<repeat_a>
		<text_a>a1</text_a>
		<repeat_b>
			<text_b>a1b1</text_b>
		</repeat_b>
		<repeat_b>
			<text_b>a1b2</text_b>
		</repeat_b>
		<repeat_b>
			<text_b>a1b3</text_b>
		</repeat_b>
	</repeat_a>
	<repeat_a>
		<text_a>a2</text_a>
		<repeat_b>
			<text_b>a2b1</text_b>
		</repeat_b>
		<repeat_b>
			<text_b>a2b2</text_b>
		</repeat_b>
		<repeat_b>
			<text_b>a2b3</text_b>
		</repeat_b>
		<repeat_b>
			<text_b>a2b4</text_b>
		</repeat_b>
	</repeat_a>
	<repeat_a>
		<text_a>a3</text_a>
	</repeat_a>
	<meta>
		<instanceID>uuid:43a8623f-1a00-4174-8bb2-712d9e048b43</instanceID>
	</meta>
</fusion-test>

When this submission is sent to Aggregate, the right things happen.

Aggregate, Repeat A

jbeorse avatar Aug 12 '17 02:08 jbeorse

This message was created automatically by mail delivery software.

A message that you sent could not be delivered to one or more of its recipients. This is a temporary error. The following address(es) deferred:

[email protected] Domain beorse.net has exceeded the max emails per hour (293/250 (117%)) allowed. Message will be reattempted later

------- This is a copy of the message, including all the headers. ------ Received: from o8.sgmail.github.com ([167.89.101.199]:40930) by hp159.hostpapa.com with esmtps (TLSv1.2:ECDHE-RSA-AES128-GCM-SHA256:128) (Exim 4.89) (envelope-from [email protected]) id 1dgMDb-000f1h-C7 for [email protected]; Fri, 11 Aug 2017 22:32:03 -0400 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=github.com; h=from:reply-to:to:cc:in-reply-to:references:subject:mime-version:content-type:content-transfer-encoding:list-id:list-archive:list-post:list-unsubscribe; s=s20150108; bh=PrL6qW+FHEvfowQuSUTsgy8IHd0=; b=a9/iJD04T79P49eN WgfAzBykFUGJPKA3v1pzn0GlJoXjOEjcrImdOan14OvfYji1NbXWlRr8z7sF715p esqm1dhxhhfUbr3aoYobfqQiSOUCL4e16ebzuxuSSiB+P3ReGTYTzKP4FAejI++D zaQo8n52ETVmxOHtBqnHsTslXFA= Received: by filter0570p1mdw1.sendgrid.net with SMTP id filter0570p1mdw1-25246-598E6878-2D 2017-08-12 02:31:20.524936339 +0000 UTC Received: from github-smtp2a-ext-cp1-prd.iad.github.net (github-smtp2a-ext-cp1-prd.iad.github.net [192.30.253.16]) by ismtpd0001p1iad1.sendgrid.net (SG) with ESMTP id Kdtu9vctTFmVFS4Ls26s9g for [email protected]; Sat, 12 Aug 2017 02:31:20.495 +0000 (UTC) Date: Sat, 12 Aug 2017 02:31:20 +0000 (UTC) From: Open Data Kit [email protected] Reply-To: opendatakit/aggregate [email protected] To: opendatakit/aggregate [email protected] Cc: Subscribed [email protected] Message-ID: opendatakit/aggregate/issues/83/[email protected] In-Reply-To: opendatakit/aggregate/issues/[email protected] References: opendatakit/aggregate/issues/[email protected] Subject: Re: [opendatakit/aggregate] Data of a repeat group inside a repeat group does not export to Fusion Table (#83) Mime-Version: 1.0 Content-Type: multipart/alternative; boundary="--==_mimepart_598e687859e3e_60343f82a7db5c2c855c1"; charset=UTF-8 Content-Transfer-Encoding: 7bit Precedence: list X-GitHub-Sender: opendatakit-bot X-GitHub-Recipient: jbeorse X-GitHub-Reason: subscribed List-ID: opendatakit/aggregate <aggregate.opendatakit.github.com> List-Archive: https://github.com/opendatakit/aggregate List-Post: mailto:[email protected] List-Unsubscribe: mailto:unsub+000519af1d58cf98af7d4a3ab4655d43d1528ccfaf682c9492cf0000000115a62a7892a169ce0ee362ba@reply.github.com, https://github.com/notifications/unsubscribe/AAUZr_I3HfM2bumPYEksy21rd_KTxk6Yks5sXQ54gaJpZM4O1SR3 X-Auto-Response-Suppress: All X-GitHub-Recipient-Address: [email protected] X-SG-EID: JVRD81wLmvjBgNlAmNtibjEbEEhcPGKEESixoxP2c46tv5lKCpc+wt51+KROkRqOOjtAkFPIXR8X+R k8kScRdyRejL4/4X1g2yyDper3beZBxUCA0TLtWYACpcgTxWRc6zT3xP9AjIUgBJwvABRl3JOPSEkz V1wLa5k9vJ7AY7dQGICSk+6kl+mc4R1e/x5tiJ+vrBdaV1m0Af8PJQ9xR5gOUBWIhzzdyQHHLAvzHa Y=

----==_mimepart_598e687859e3e_60343f82a7db5c2c855c1 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit

Comment by mitchellsundt Tuesday Jan 03, 2017 at 21:13 GMT


This was an intentional limitation of repeat-group support in the publishers. I think Waylon coded these in a few days; constructing the top-level view was becoming insanely difficult.

Repeat group support is also broken in significant ways in Sheets.

-- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/opendatakit/aggregate/issues/83#issuecomment-321952090 ----==_mimepart_598e687859e3e_60343f82a7db5c2c855c1 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

Comment by mitchellsundt
Tuesday Jan 03, 2017 at 21:13 GMT


This was an intentional limitation of repeat-group support in the publis= hers. I think Waylon coded these in a few days; constructing the top-level = view was becoming insanely difficult.

Repeat group support is also broken in significant ways in Sheets.

&mda= sh;
You are receiving this because you are subscribed to this thread.Reply to this email directly, view it on GitHub, or mute the thread.3D""

=

----==_mimepart_598e687859e3e_60343f82a7db5c2c855c1--

jbeorse avatar Aug 12 '17 02:08 jbeorse

Attention! We're housekeeping! This issue will automatically be closed if no feedback is received in one week.

If this issue is important to you or you can provide more information about it, please, do so as soon as possible :)

ggalmazor avatar Nov 06 '17 19:11 ggalmazor