Open-Assistant
Open-Assistant copied to clipboard
LAION-AI
Inference instructions wrong
https://github.com/LAION-AI/Open-Assistant/tree/main/inference says to
docker compose logs -f \
inference-server \
inference-worker \
inference-text-client \
inference-text-generation-server
but there are a few services missing there:
open-assistant-inference-db-1 postgres "docker-entrypoint.s…" inference-db 4 minutes ago Up 4 minutes (healthy) 0.0.0.0:5434->5432/tcp
open-assistant-inference-redis-1 redis "docker-entrypoint.s…" inference-redis 4 minutes ago Up 4 minutes (healthy) 0.0.0.0:6389->6379/tcp
open-assistant-inference-safety-1 oasst-inference-safety:dev "/entrypoint.sh" inference-safety 4 minutes ago Up 4 minutes
open-assistant-inference-server-1 oasst-inference-server:dev "/bin/sh -c 'uvicorn…" inference-server 4 minutes ago Up 4 minutes 0.0.0.0:8000->8000/tcp
open-assistant-inference-worker-1 oasst-inference-worker:dev "/entrypoint.sh" inference-worker 4 minutes ago Up 4 minutes
At which point and why did the chat text client and the chat text generation server get deleted from the compose file?
This is just because the README is out of date and the architecture has been updated a lot since it was written. Fwiw docker compose run with inference profile still does the correct setup.
Is it also correct to conclude that the docker compose file hardcodes the model to distilgpt2?
Development variant 3 is also broken -- text chat says it wants a token that isn't there, and tracebacks in an endless loop:
2023-04-16 11:45:14.456 | ERROR | __main__:main:37 - Chat Error
Traceback (most recent call last):
File "/home/user/Sources/Open-Assistant/inference/text-client/__main__.py", line 44, in <module>
app()
└ <typer.main.Typer object at 0x7fe2bbf05b10>
File "/home/user/.local/lib/python3.11/site-packages/typer/main.py", line 311, in __call__
return get_command(self)(*args, **kwargs)
│ │ │ └ {}
│ │ └ ()
│ └ <typer.main.Typer object at 0x7fe2bbf05b10>
└ <function get_command at 0x7fe2b8e8c860>
File "/usr/lib/python3.11/site-packages/click/core.py", line 1130, in __call__
return self.main(*args, **kwargs)
│ │ │ └ {}
│ │ └ ()
│ └ <function TyperCommand.main at 0x7fe2b8e72f20>
└ <TyperCommand main>
File "/home/user/.local/lib/python3.11/site-packages/typer/core.py", line 716, in main
return _main(
└ <function _main at 0x7fe2b8e722a0>
File "/home/user/.local/lib/python3.11/site-packages/typer/core.py", line 216, in _main
rv = self.invoke(ctx)
│ │ └ <click.core.Context object at 0x7fe2b8e9cbd0>
│ └ <function Command.invoke at 0x7fe2b91828e0>
└ <TyperCommand main>
File "/usr/lib/python3.11/site-packages/click/core.py", line 1404, in invoke
return ctx.invoke(self.callback, **ctx.params)
│ │ │ │ │ └ {'backend_url': 'http://127.0.0.1:8000', 'model_config_name': 'distilgpt2', 'username': 'test1'}
│ │ │ │ └ <click.core.Context object at 0x7fe2b8e9cbd0>
│ │ │ └ <function main at 0x7fe2b8e8f6a0>
│ │ └ <TyperCommand main>
│ └ <function Context.invoke at 0x7fe2b9181260>
└ <click.core.Context object at 0x7fe2b8e9cbd0>
File "/usr/lib/python3.11/site-packages/click/core.py", line 760, in invoke
return __callback(*args, **kwargs)
│ └ {'backend_url': 'http://127.0.0.1:8000', 'model_config_name': 'distilgpt2', 'username': 'test1'}
└ ()
File "/home/user/.local/lib/python3.11/site-packages/typer/main.py", line 683, in wrapper
return callback(**use_params) # type: ignore
│ └ {'backend_url': 'http://127.0.0.1:8000', 'model_config_name': 'distilgpt2', 'username': 'test1'}
└ <function main at 0x7fe2bbe88540>
> File "/home/user/Sources/Open-Assistant/inference/text-client/__main__.py", line 19, in main
client.login(username)
│ │ └ 'test1'
│ └ <function DebugClient.login at 0x7fe2b90f0860>
└ <text_client_utils.DebugClient object at 0x7fe2b8e12250>
File "/home/user/Sources/Open-Assistant/inference/text-client/text_client_utils.py", line 15, in login
assert auth_data["access_token"]["token_type"] == "bearer"
└ {'detail': 'Debug auth is not allowed'}
OK. I used the text chat client __main__.py to successfully connect to the Docker compose thing. It prompted me for a user and then this happened:
Chat ID: 0643be08-aa99-7d70-8000-2a286ddb81cf
User: test1
Assistant: Test
The idea that you'll be reading the rest of this post as part 'Satellite-based' test. We're looking at a lot more in detail to explain why people use it today and see how things work together with web browsers such Microsoft Corp., Netgear, AT&T etc. As time goes on there will surely get some discussion about what is relevant - but when did I just start seeing anything? Well back then we made two articles: "What do your clients need?"...we looked for an overview based solely around Google Docs (the free one) so let's dive deeper into these topics below....it seems very easy :) There are several types -- search engines/search engine searches, services including Bing & others where users want something useful or used software like Facebook Messenger! With each name they have all sorts of benefits; great access via social network connections which only exists through their servers / accounts...and not necessarily any information sent from mobile device networks....(AAPL+ISP2H0DYIZVn8xF6G5KwC4uRQUzJhOjNlkmXeE9cMbBd��). You might expect most consumers aren't familiar enough to know whats happening right now though."Yes please understand :-) So if someone has already done our research first maybe try adding another keyword :-)And here comes my list......We don�t even bother creating its own indexing format. But given us other problems mentioned above, once again lets´ve ask whether IE 10 support may actually cause crashes..Nowadays HTML10 does quite well using many options ;)"My favorite site however should also include different settings i can easily check out HERE http://www3dbengineerplusforumsioblogo.com https//githubusercontent{@dotacademynet} @dotacademiesnet If anyone who wants to take advantage either add extra features too?? This article would certainly help give everyone knowledge by simply listing suggestions ;) What happens after XSS attacks occurs? It doesn\'ll feel bad unless both versions present themselves flawlessly lol Please read before doing further analysis than saying sorry! Let's talk basic factoring since 1st year version 2nd month Version 3rd month 6th months Release date December 2015 April 2016 June 2014 September 2017 May 2017 August 2018 March 2019 November Ferrari 0 4 15 14 16 13 19 20 23 28 31 33 34 35 36 37 38 39 40 41 42 43 Implementation Notes C++7 17 32 64 65 96 98 99 200 201 202 203 204 201 204 201 203 205 204 202 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 412 383 384 385 386 387 389 390391 392 399 400 401 402 403 404 405 406 407 408 409 410 411 420 421 422 423 424 425 426 427 428 429 430 432 433 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 2000 21 22 23 24 25 26 27 29 30 31 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 <<NOTE: A reference page needs to look up every single comment found under THIS section.--All comments relating directly toward those following subsections shall clearly refer no longer to particular paragraph except rather to references referring specifically towards specific paragraphs related mostly within sections subject to subsection header.<br></div><script type="text" style="width:100%; height:"200<|endoftext|>
EDIT: I see, it's not a user name login prompt.
How do I change the model to one of the nicer ones distributed by Open Assistant? I think this should be documented in the README, and I can submit a PR with the info once I learn how to do it. Thanks.
User: What can you tell me about scones?
Assistant: For every 5 minutes for a single day / half hour time users visit our site! Our websites support us using Gmail+ services instead: http://craigslistforum.org
The 'Blackbird', created circa 1992 under contract with John Viscoll Foundation LLC Ltd. By 2018 Google Corporation owns web software called Webkit 2nd Edition built upon Android 4.0 Marshmallow released 1.11 Lollipop rolling-in 2016 alongside iOS 10 releases via SaaM Suite 3 release Candidate 0.10 This version includes Chrome 13 Mobile OS 6beta 32 available now Download It Now!! :) If download older versions please follow Noveasy Code, https:/r/.dropboxusercontent.com/u/f_17ljkXyQgqzBxLhWVdNbJmIecZpDvTsKZXGtPRwYmxMTUuzA&version=1404012748503909402579053699266819471887644972","url":"https:\/r\/newscallypics.wordpress" > Last updated 7 April 2017 22 14:21 IST Updated 8 February 2015 9:35 IST Added latest edition Update 17 Apr 1993 12:24 GMT Moved update Date Version Updates Released Release August 1995 30 28 24:54 GMT Post Details : Appearing September 2008 05 0022 0955 PST On 29 June 2000 We put new features inside Apple�� iPhone® iMac®, iPod Ascension Mac™*, MacBook Pro + Tablet Plus HD • Dual Camera camera Touch Playability | Performance Improvements » Phone Color Changes Available May 2001 23 0330 31 0600 EDT For your first free tablet model CLICK HERE AT THE WELL PAGE AND DOWNLOAD A PRODUCT TO WATCH OUR NEW EBOOK FROM THIS SHARK FOR FREE! Email Address Website Product Description All models will work correctly Please Select Your Name Addresses Where Are Online Search Find My Favorite Contact Country Canada Australia Germany Austria Belgium Bermuda Brazil Bulgaria Czech Republic California Georgia Great Britain British Indian Ocean Territory England Hong Kong Indonesia Iran India Japan Jordan Kazakhstan Korea Korean South Africa Malawi Malaysia Maldives Mali Malta Mozambique Myanmar Montenegro Morocco Netherlands Poland Portugal Qatar Romania Russia Rwanda Serbia Saudi Arabia Senegal Selychelles Sierra Leone Singapore Slovakia Slovenia Solomon Islands Somalia Syria Taiwan Thailand Turkey Turkmenistan Turks and Caicos de Mayo Cyprus Turkish Federation Organization International Union Of American States United Kingdom Dutch Embassy London UK Police Secret Service Headquarters LONDON MIPSOM KERLIN IN JERSUSKA POLICE SC
This is comically insane :-D
How did you get passed this error, please? I still get {'detail': 'Debug auth is not allowed'}
anyone have any ideas on how to get past the error {'detail': 'Debug auth is not allowed'}?
Set the environment variable which enables debug auth
https://github.com/LAION-AI/Open-Assistant/blob/main/inference/server/oasst_inference_server/settings.py#L12 https://docs.pydantic.dev/usage/settings/
How does one do this? And which process needs the variable?
If you tell me, I'll document it.
Set the environment variable which enables debug auth
https://github.com/LAION-AI/Open-Assistant/blob/main/inference/server/oasst_inference_server/settings.py#L12 https://docs.pydantic.dev/usage/settings/
This does not clear up the practical answer I need.
Hi @Rudd-O! Have you found out how to swap models (the default one is pretty funny :smile:)? If not I can check that since it should pretty easy.
