opamdoc can't build the universe and tell you its troubles

[dsheets]

I use this script to install a large, consistent universe on top of #1 :

#!/bin/sh

# automatic conflicts: cryptokit-sha512, ocamlgsl, ocaml-taglib
# manual conflicts: mirage-xen, mirage-net-direct, oasis-mirage
# lagging conflicts: biocaml (core <= 109.17.00)
# mistaken conflicts: xenbigarray

2> universe.err > universe.out time -v -o universe.time \
opam install --verbose --json=universe.json --yes \
gstreamer \
gtktop \
headache \
herelib \
hevea \
hweak \
ibx \
imagemagick \
inotify \
inspect \
integration1d \
ipaddr \
irc-client \
javalib \
jenga \
js_of_ocaml \
json-static \
json-wheel \
jsondiff \
jsonm \
kaputt \
krb5 \
lablgl \
lablgtk \
lablgtk-extras \
lacaml \
ladspa \
lambda-term \
lame \
lastfm \
lbfgs \
ledit \
libsvm \
libvhd \
libvirt \
lilis \
liquidsoap \
litiom \
llvm \
lo \
lpd \
lwt \
lwt-binio \
lwt-zmq \
lz4 \
lzo \
macaque \
macaque_lwt \
magic \
melt \
menhir \
merlin \
mesh \
milter \
mirage \
mirage-fs \
mirage-net \
mirage-net-socket \
mirage-unix \
mirage-www \
mirari \
missinglib \
mldonkey \
mlgmp \
mlorg \
mlpost \
mm \
monadlib \
mparser \
mpi \
msgpack \
mysql_protocol \
nbd \
nlopt-ocaml \
numerix \
oasis  \
oasis2opam \
objsize \
obuild \
obus \
ocaml+twt \
ocaml-arg \
ocaml-buddy \
ocaml-data-notation \
ocaml-expat \
ocaml-expect \
ocaml-glpk \
ocaml-http \
ocaml-indent \
ocaml-inifiles \
ocaml-lua \
ocaml-mad \
ocaml-makefile \
ocaml-markdown \
ocaml-mysql \
ocaml-posix-resource \
ocaml-radixtree \
ocaml-rdf \
ocaml-sqlexpr \
ocaml-text \
ocaml-top \
ocaml-usb \
ocaml-xdg-basedir \
ocaml-xml-rpc \
ocaml-zmq \
ocaml_plugin \
ocamlclean \
ocamldap \
ocamldbi \
ocamldiff \
ocamldot \
ocamldsort \
ocamlfind \
ocamlfuse \
ocamlgraph \
ocamlify \
ocamlmod \
ocamlnet \
ocamlpp \
ocamlrss \
ocamlscript \
ocamlsdl \
ocamltop-gtk \
ocamlviz \
ocamlwc \
ocamlweb \
ocapic \
oclock \
ocp-build \
ocp-indent \
ocp-index \
ocplib-endian \
ocsfml \
ocsigenserver \
ocurl \
odb-server \
odepack \
odiff-gtk \
odisco \
ogg \
omake \
omd \
omonad \
oni \
opa-base \
opam-doc \
opam-lib \
opam2web \
opamdoc \
opamdoc-divert \
opass \
openflow \
optcomp \
optimization1d \
opus \
oqamldebug \
orakuda \
orm \
ospec \
ott \
ounit \
ox \
p3 \
pa_comprehension \
pa_monad_custom \
pa_ounit \
pa_ovisitor \
pa_test \
pa_where \
packet \
pareto \
parmap \
patdiff \
patoline \
pcap-format \
pcf-format \
pcre-ocaml \
pgocaml \
pipebang \
piqi \
planck \
plasma \
pomap \
portaudio \
postgres \
postgresql-ocaml \
pprint \
profound \
promela \
protobuf \
pulseaudio \
pxp \
qmp \
qtest \
quickcheck \
re \
re2 \
react \
regstab \
release \
res \
riak \
riak-pb \
riakc \
rml \
root1d \
rope \
rpc \
rtime \
safepass \
samplerate \
sawja \
schoca \
schroedinger \
sedlex \
sequence \
sexplib \
sha \
shared-memory-ring \
should \
simple_pam \
smtp \
snappy \
sodium \
sonet \
soundtouch \
speex \
spf \
spotinstall \
spotlib \
spotlib_js \
sqlgg \
sqlite3-ocaml \
srs \
ssl \
stemming \
stog \
stog-rdf \
stog-writing \
stone \
syslog \
taglib \
textutils \
textwrap \
theora \
thrift \
tiny_json \
tplib \
tptp \
tstp-proof-checker \
tuntap \
type_conv \
typehashlib \
typerex \
tyxml \
ucorelib \
uint \
ulex \
unison \
uri \
utop \
uucd \
uuidm \
uunf \
uutf \
variantslib \
vector3 \
vhd-format \
voaacenc \
vorbis \
webdav \
weberizer \
websocket \
wget \
why \
why3 \
wyrd \
xen-api-client \
xen-block-driver \
xen-disk \
xenctrl \
xenstore \
xenstore_transport \
xml-light \
xmlm \
xmlplaylist \
xstr \
xstrp4 \
xtmpl \
yajl \
yajl-extra \
yojson \
zarith \
zed \
zenon \
zero \
aacplus \
abella \
ackdo-reloaded \
aez \
agrep \
aifad \
aio \
alberto \
alphaCaml \
alsa \
alt-ergo \
ancient \
annexlib \
annot \
ansicolor \
ANSITerminal \
ao \
apalogretrieve \
archimedes \
argot \
async \
async_core \
async_extra \
async_find \
async_graphics \
async_inotify \
async_parallel \
async_shell \
async_smtp \
async_unix \
ccss \
cdrom \
cduce \
cfg \
cfstream \
cgi \
chamo \
choice \
cil \
cmdliner \
cohttp \
combine \
comparelib \
conf-cairo \
conf-expat \
conf-ftgl \
conf-glew \
conf-gnomecanvas \
conf-gsl \
conf-gtksourceview \
conf-libcurl \
conf-libev \
conf-libffi \
conf-libMagickCore \
conf-libpcre \
conf-libpng \
conf-llvm-debug \
conf-lua \
conf-ode \
conf-sdl-gfx \
conf-sdl-image \
conf-sdl-mixer \
conf-sdl-ttf \
conf-sdl2 \
conf-sfml2 \
config-file \
coq \
coqide \
core \
core_bench \
core_extended \
core_kernel \
cow \
cpdf \
cppo \
crunch \
cry \
crypt \
cryptgps \
cryptokit \
cstruct \
csv \
ctypes \
cudf \
curses \
custom_printf \
datalog \
dbforge \
dbm \
delimcc \
deriving \
deriving-ocsigen \
dns \
dnscurve \
dolog \
dose \
dssi \
dtools \
dum \
duppy \
dyntype \
dypgen \
easy-format \
eliom \
email_message \
erm_xml \
erm_xmpp \
erssical \
estring \
extlib \
extprot \
extunix \
faad \
facile \
faillib \
fd-send-recv \
ffmpeg \
fftw3 \
fieldslib \
fileutils \
fix \
flac \
flow \
flowcaml \
forkwork \
format \
frama-c \
freetds \
frei0r \
frenetic \
froc \
FrontC \
ftp \
functory \
fury-puyo \
gammu \
gapi-ocaml \
gavl \
genet \
genspir \
geoip \
getopt \
gettext \
github \
glMLite \
google-drive-ocamlfuse \
gperftools \
gpr \
graphicspdf \
gsl \
bolt \
cairo \
cairo2 \
calendar \
caml2html \
camlbz2 \
CamlGI \
camlgpc \
camlidl \
camlimages \
camlmix \
camlp5 \
camlpdf \
camltemplate \
camlzip \
camomile \
atd \
atdgen \
aws \
baardskeerder \
base-bigarray \
base-threads \
base-unix \
batteries \
beluga \
bench \
benchmark \
bes \
bigbro \
bin-doc \
bisect \
bitcoin \
bitstring \
bitv \
bjack \
blahcaml \
bin_prot \
binary \
biniou \

Make sure you have libev-dev or equivalent and other conf-* package dependencies installed because all optional dependencies will be triggered. #1's opamdoc-rebuild runs fine but when you run opamdoc-generate, the following occurs:

annot.1.0.0 annot
apalogretrieve.0.9.6-4 apalogretrieve
bin-doc.0.1 bin-doc
Unsupported value representation
Unsupported value representation
abella.2.0.1 abella
Unsupported value representation
[Warning] Mismatching items
Unsupported value representation
Unsupported value representation
Unsupported value representation
camlidl.1.05 camlidl
headache.1.03 headache
Unsupported value representation
flowcaml.1.07 flowcaml
hweak.1.1 hweak
facile.1.1 facile
lablgl.20120306 lablgl
hevea.2.01 hevea
Unsupported value representation
[Warning] Mismatching items
Unsupported value representation
Unsupported value representation
Unsupported value representation
[Warning] Mismatching items
[Warning] Mismatching items
[Warning] Mismatching items
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
[Warning] Mismatching items
Unsupported value representation
[Warning] generate_type_kind : Unbound documentation
[Warning] generate_type_kind : Unbound documentation
Unsupported value representation
Unsupported value representation
Unsupported value representation
[Warning] Mismatching items
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
[Warning] Mismatching items
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
obuild.0.0.2 obuild
ocaml+twt.0.93 ocaml+twt
Unsupported value representation
[Warning] Mismatching items
[Warning] Mismatching items
Unsupported value representation
[Warning] Mismatching items
[Warning] Mismatching items
[Warning] Mismatching items
ocaml-arg.0.3 ocaml-arg
Unsupported value representation
ocamlclean.2.0 ocamlclean
ocamldsort.0.15.0 ocamldsort
ocamlfind.1.4.0 ocamlfind
Unsupported value representation
Unsupported value representation
[Warning] Mismatching items
ocamlpp.1.0 ocamlpp
numerix.0.22 numerix
Unsupported value representation
Unsupported value representation
odb-server.0.1 odb-server
Unsupported value representation
ott.distro-0.21.2 ott
mldonkey.3.1.3 mldonkey
Unsupported value representation
Unsupported value representation
uutf.0.9.3 uutf
camlp5.6.11 camlp5
Unsupported value representation
Unsupported value representation
[Warning] Mismatching items
[Warning] Mismatching items
[Warning] Mismatching items
Unsupported value representation
Unsupported value representation
Unsupported value representation
[Warning] Mismatching items
[Warning] Mismatching items
Unsupported value representation
Unsupported value representation
[Warning] Mismatching items
Unsupported value representation
Unsupported value representation
Unsupported value representation
[Warning] Mismatching items
[Warning] Mismatching items
[Warning] Mismatching items
[Warning] Mismatching items
[Warning] Mismatching items
[Warning] Mismatching items
Unsupported value representation
Unsupported value representation
[Warning] Mismatching items
[Warning] Mismatching items
[Warning] Mismatching items
Unsupported value representation
Unsupported value representation
[Warning] Mismatching items
Unsupported value representation
Unsupported value representation
Unsupported value representation
[Warning] Mismatching items
[Warning] Mismatching items
[Warning] Mismatching items
[Warning] Mismatching items
[Warning] Mismatching items
[Warning] Mismatching items
Unsupported value representation
[Warning] Mismatching items
Unsupported value representation
Unsupported value representation
[Warning] Mismatching items
Unsupported value representation
[Warning] Mismatching items
Unsupported value representation
Unsupported value representation
Unsupported value representation
[Warning] Mismatching items
[Warning] Mismatching items
[Warning] Mismatching items
[Warning] Mismatching items
Unsupported value representation
Unsupported value representation
[Warning] Mismatching items
regstab.2.0.0 regstab
Unsupported value representation
[Warning] Mismatching items
[Warning] Mismatching items
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
agrep.1.0 agrep
wyrd.1.4.6 wyrd
alphaCaml.20061214 alphaCaml
Unsupported value representation
Unsupported value representation
alsa.0.2.1 alsa
ansicolor.0.5 ansicolor
ancient.0.9.0 ancient
ANSITerminal.0.6.5 ANSITerminal
argot.1.1 argot
Unsupported value representation
binary.0.1 binary
bisect.1.3 bisect
Unsupported value representation
Unsupported value representation
bitv.1.1 bitv
bitstring.2.0.4 bitstring
rml.1.09.01 rml
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
calendar.2.03.2 calendar
bolt.1.3 bolt
Unsupported value representation
camlbz2.0.6.0 camlbz2
camlgpc.1.0 camlgpc
caml2html.1.4.3 caml2html
Unsupported value representation
camltemplate.1.0.2 camltemplate
Unsupported value representation
CamlGI.0.6 CamlGI
camlzip.1.04 camlzip
batteries.2.1.0 batteries
cgi.0.8 cgi
cdrom.0.9.1 cdrom
Warning: missing cmt file: /home/dsheets/.opam/4.01.0beta1+opamdoc/opamdoc/cdrom.0.9.1/f828b0b3fc103743e1e5d7768277e42e/cdrom.cmdi
choice.0.1 choice
camlpdf.1.7.1 camlpdf
config-file.1.1 config-file
cmdliner.0.9.2 cmdliner
cry.0.2.2 cry
crypt.1.2 crypt
cryptgps.0.2.1 cryptgps
cryptokit.1.7 cryptokit
csv.1.3.1 csv
Unsupported value representation
curses.1.0.3 curses
datalog.0.4.1 datalog
Unsupported value representation
cil.1.7.3 cil
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Unsupported value representation
Fatal error: exception Assert_failure("generate.ml", 617, 12)

This is not useful output which makes debugging opamdoc very hard.

The behavior is not functional which makes using opamdoc to map over large opam universes (like above) basically impossible.

Please improve the output and behavior of opamdoc.

[avsm]

The liveblog for this talk is at http://icfp2016.mirage.io/CUFP/creating-an-approachable-haske.md. The file to edit is https://github.com/ocamllabs/icfp2016-blog/blob/master/CUFP/creating-an-approachable-haske.md