fansub-guide icon indicating copy to clipboard operation
fansub-guide copied to clipboard

Published 20 hours ago • verified publisher icon zeriyu
→

Metadata

Fork from https://gist.github.com/YukinoAi/acea024631a2585aa592b16b4bde959f

Fansubbing and Encoding Guides Index

  • Fansubbing and Encoding Guides Index
    • Fansubbing Overview
    • Capping
      • Capping Theory
      • Links
        • Digital TV/Cable/Satellite
        • Digital Video Disc (DVD)
        • DVD/Blu-ray Disc (BD)
        • Webrips
    • Encoding
      • Video Theory (Basic)
      • Video Theory (Complete)
      • Codec and Container Theory
      • Luma and Color Theory
      • Framerate Theory
      • Interlacing Theory
      • Codec Bit Allocation Theory
      • Resolution Theory and Standards
      • Audio Theory
      • Encoding and Release Standards
      • Concrete Guides (completely random)
      • Specific Software
        • FFMPEG
        • x264/x265
      • Audio Encoding
      • QC (?)
    • Playback
      • Computer
      • HTPC
    • Muxing and Demuxing
      • Muxing and Demuxing Theory
      • Muxing tools
    • Filtering
      • Preface
      • Filtering Theory
      • Examples
      • Understanding and Identifying Artifacts
      • Frameworks
        • AviSynth
        • VapourSynth
        • Additional programs used
        • Further reading
      • Scene Filtering
      • Working with Groups of Pictures (GOPs)
      • Masktools
      • Real-time filtering
    • Translating (TL) + Translate Check (TLC)
    • Timing, Fine Timing, Scene Timing, Key Frame Timing (KFT), Karaoke Timing (KT)
    • Editing + Quality Check (QC)
    • Typesetting
      • Styling Theory
      • Styling Links
      • Typesetting Theory
      • Typesetting Links
      • Karaoke Effects (KFX)
        • Prerequisite reading
        • Working with templates
        • Kara Effector
        • Creating KFX
    • Distribute (Distro)
      • #1: Torrents
      • #2: Hyper Text Transport Protocol (HTTP) (+ Transport Layer Security (TLS))
      • #3: Internet Relay Chat (IRC)
      • File Transfer Protocol (FTP)
      • Newsgroups
      • Random Distro Tools
      • The Group Blog
      • Distro For Do It Yourself (DIY) People
        • General Mandatory Reading
        • DNS/Dynamic DNS (DDNS)
        • Raspberry Pi
        • Seedbox Software
        • HTTP File Server
        • TLS
    • Remux
      • Subtitle Preprocessing Tools
      • Workflow
    • In Service of Chaos: Analog
      • Analog Video Broadcasting History (fascinating btw)
      • Analog Decoding and Artifacting
      • Consumer Media Overview and Resources
      • Analog Capture Guides

Fansubbing Overview

Theory Anime Fansubbing History and The State of Fansubbing: It's Dead [PDF].

  • [PDF] Doki's Fansubbing Process Overview, and this random Idiot's Guide.
  • Implementation: unanimated's Guide Index, PDF. Alternatives:
    • Commie Guides Index.
    • SubsByRock Index.
  • Aegisub: the core tool for fansubbers. Binaries.
  • Random Fansubbing tips (group oriented).
  • A day in the life: blog post, Interviews, and YT playlist and what it used to be like: web.archive.org/web/20021013081748/http://pepper.idge.net:80/digisub.html, PDF.

Capping

Capping Theory

The idea is to obtain the source media.

The best sources are usually raw Digital Video Disc (DVD) or raw Blu-ray Disc Movie (BDMV) but uploads are not always available.

If not, then capping can also mean buying the retail media. Consider buying Anime DVDs/BDs to support the industry. Otherwise, existing VHS/LD/DVD/BD or web rips can be of acceptable quality.

For broadcast streams, capping means recording the analog stream and then digitizing it with special hardware or, for internet simulcasts (digital), means stream copying with special software. Sometimes raws can also be obtained from invite-only private trackers. See the "Remux" section for capturing subtitles.

Links

For Analog TV, 8mm, VHS and LD, see Analog Video

To extract subtitles, please see the Muxing and Remux sections.

For general subtitle conversion: Subtitle Edit and their documentation.

For simple stream extraction: MKVToolNix + gMKVExtractGUI, or even just FFMPEG. Also see Muxing section.

Digital TV/Cable/Satellite

Digital Signal Processing. Have fun.

Digital Video Disc (DVD)

DVD-Decrypter, a DVD Decrypter Guide, PDF and a second guide.

DVD/Blu-ray Disc (BD)

MakeMKV, and Handbrake and MakeMKV Guide.

Webrips

  • youtube-dl, Graphical User Interface (GUI). "Industry standard" and supports multiple sites, including Crunchyroll (CR).
    • Youtube sometimes blocks videos based upon region. To bypass, use this region checker and a Virtual Private Network (VPN) with an exit point in an unblocked region.
  • Crunchyroll-XML-Decoder + workaround instructions (January 2017). Supports multilingual subtitle only downloads.
  • Crunchyroll Downloader Toolkit DX, Mediafire, Mega. Windows only. Note: I have not tested this.
  • Crunchyroll-Download-Tool (extension of DX toolkit for bulk downloads). Note: I have not tested this.
    • Old: Funimation Downloader. Note: Broken as of ~January 2017 due to Funi site update.
    • Seiya's Funimation-Downloader-nx and GUI. Note: I have not tested this. Also: related cat.
    • For Netflix, Amazon and Hulu, the only known working non-scene ripping method is screen capture software like OBS, or 100% manual RTMP transport stream rips.
      • Further reading: netflix-subtitle-downloader. Note: I have not tested this.

DVD raws, BDMVs, and webrips can also be obtained second hand from other people. See the Distribute section.

Encoding

Video Theory (Basic)

Video can be described as a series of pictures shown quickly in succession.

The most basic reasons to encode video are to preserve complex changes (such as any filtering) and to make the video stream smaller. Even a minute of raw uncompressed video is several GigaBytes (GB) in size. The basic idea is to reduce the file size to subjective "acceptable" levels while retaining the highest quality possible.

Motion Picture Engineering Group (MPEG) video encoding works by compressing one picture (known as a "key frame") and then recording any changes between that frame and the next frame. And then recording the changes between that second frame and the frame after and so forth. To display any given frame, every frame before it must be decoded starting from the nearest previous key frame.

Video Theory (Complete)

Following encoding guides without understanding the theory is just asking for trouble, but, with so much background necessary, there is just not a good place to starting learning about video encoding. This one is close: A&E's Technical Guides to All Things Audio and Video (v3), PDF. Read this in its entirety.

No excuses.

A&E's guide is dated but very good for theory. More modern workflow guides are found further below.

Codec and Container Theory

  • Watch this video: How Codecs Work - Tutorial All of it!.
  • Container VS Codec: Media Formats and How to Choose the Right Codec and read this discussion.
  • Wikipedia (Wiki): Codec Comparison, Container Comparison, MPEG standards.
  • HEVC Review 1, 2, PDF and 3.
  • For reference: Video Codecs by FOURCC and related summary.

Luma and Color Theory

  • Human Color Perception and related quirks.
  • Adobe Video Road blog: Understanding Color, What is YUV, Color Subsampling.
  • 8-bit vs 16-bit.
  • Bit Depth Tutorial.
  • Doki - Discussion: 10-bit h264 or here are the linked PDFs: 10-bit AVC Broadcasting, Why 10-bit Saves Bandwidth, 10-bit Presentation.
  • Interesting related blog post.
  • Understanding Histograms, Part 2 and an example.
  • Understanding White Balance.
  • Dynamic Range.
  • Interesting case studies:
  • Wiki: Color space, Rec601 and Rec709.
  • NTSC vs PAL color primaries.
  • Example of YCbCr color componet data ranges.
  • Information on different YUV sub-sampling patterns.
  • PSNR comparison of different YUV sub-sampling patterns when performing color family conversions: Quality of RGB-YUV-RGB conversion.

Framerate Theory

  • How many frames can humans see?, PDF.
  • The frames per second (FPS) theory guide also covers "smoothness" by blurring and luma sensitivity.
    • Understanding FFMPEG's Group of Pictures (GOP) Options.
  • Variable Frame Rate: VFR for Fansub Encoders, PDF
  • AviSynth's Working with VFR guide and VFRaC Workarounds.
  • FPS theory sandbox: frames-per-second.appspot.com.

Interlacing Theory

Codec Bit Allocation Theory

Resolution Theory and Standards

Audio Theory

Encoding and Release Standards

These exist to ensure client hardware decoding compatibility. Please note that compatibility is not emphasized in the Anime community.

  • Apple's General Authoring Requirements.
  • Youtube's Recommended upload encoding settings.
  • "Scene" release standards for Anime, x264, DVDrips, BDrips.
  • Microsoft's Video Media Types and supported formats.

Concrete Guides (completely random)

  • Koby/Finayra's concrete Beginner's Guide, or "Quickstart Guide", to modern A/V encoding. This guide is a translation of TODO: [eXmendic's guide] also covers 16-bit filtering (advanced).
  • Installing HuffYUV on Windows 64-bit.
  • Doom9 Forum and guides index.
  • Frame accurate indexing of DVD Video Object (.VOB) files: DGIndex for use with AviSynth. Also: see this related guide.
  • Encoding Tips for Mini-Size.
  • Random Index of Converting Guides and Afterdawn's Guides Index.
  • Monitor Calibration for Photography.
  • l33tmeatwad's Software List.
  • DarkDream787's Encoding Tutorials (PDFs):
    • Required Software List.
    • How to backup DVDs to HDD and Blu-Rays to HDD.
    • How to create .SRT or .ASS subtitles From DVDs and From Blu-Rays.
    • How to Encode High Quality Audio From DVDs/BDs.
    • How to use AVISynth.
    • How to Encode AVISynth scripts in MeGui.
    • Cutting-Splitting-Merging Video and Audio.
    • How to make an MKV File From Video, Audio, and Subtitle Files.
  • Random Software List: Ask an Experienced Encoder, PDF.

Specific Software

(near top means easier to use, near bottom means full featured)

  • Handbrake, and a Related Guide.
  • vEncode Project Page and releases. Note: Uses a Command Line Interface (CLI).
  • MeGUI, Project Thread, and Guide, PDF.
  • StaxRip: VideoHelp page, GitHub Project Page, and Handbook.
  • Hybrid supports a Graphical User Interface (GUI).

FFMPEG

  • Getting Started: FFmpeg: The ultimate Video and Audio Manipulation Tool, PDF.
  • Getting Started 2: A Guide To Video And Audio Conversion Using FFmpeg.
  • Useful FFmpeg Commands.
  • FFmpeg and H.264 Encoding Guide.
  • How to burn subtitles into the video.
  • Official source and binaries, Cross Compiling for Windows, build helpers, and Todo: nvenc compile guide and [3.2 binaries].
  • FFmpeg wiki, Official Cryptic Documentation, cryptic Arch Docs.
  • Advanced guide to Creating Multiple Outputs (simultaneous 480p, 720p, and 1080p encoding).

x264/x265

Audio Encoding

  • FFMPEG High Quality Audio Guide.
  • eac3to: Command Line Interface (CLI) audio encoding tool with many Graphical User Interfaces (GUIs) available.
  • DarkDream787's How to Encode High Quality Audio From DVDs/BDs.
  • Opus codec Comparison and FAQ.

QC (?)

Bitrate Viewer Able to estimate the quality of MPEG1 and MPEG2 streams. I do not know how this is useful but Etzimal said to add it. o_o*

Playback

Computer

  • For DVDs, diagnostics and saving network streams (NOT normal viewing): VLC Media Player.
  • For Windows pick ONE (will install MPC and LAV automatically):
  • MediaInfo is installed automatically with K-Lite CP. Otherwise, install it manually if necessary.
  • mpv, prescalers, is a modern fork of MPlayer. mpv FAQ, Wiki and Moodkiller's guide.
    • MPlayer is a cross platform media player. ArchLinux's documentation, and official technical documentation.
  • Advanced tips on LAV splitter stream selection.
  • madVR, FAQ, is a gpu-accelerated "renderer" that can display video with increased fidelity compared to default settings. It also supports realtime filters for sharpening, color correction and other things. The implementation is as a Windows plug-in for various players including MPC-HC and mpv. After being automatically installed with K-Lite Codec Pack or installed manually, it must be selected for use within the player, hence the following guides:
    • Kametsu guide for MPC-HC + LAV/madVR/xy-subfilter.
    • Or for mpv: Scum's Raws guide.
    • Some more: ranpha's PotPlayer guide, BakaBT Wiki, CoalGirls - 2011, another one and finally Nand's Guide, mirror, PDF.
    • Advanced: ranpha's very detailed madVR settings configuration guide, PDF.

HTPC

  • Remote: Use this, or
  • A wireless keyboard, mini version.
  • For a dedicated HTPC box: Kodi (formally XBMC).
    • Note: Natively, the Raspberry Pi 3 B cannot properly decode 10-bit content.
    • Notable Variants: LibreElec, OpenElec, Plex.
  • For a Client-Server model (recommended): either Plex (closed source) or Emby, formally Media Browser, (open source).
    • Plex/Emby realtime transcoding (free) means all client devices will always be able to decode streams properly (universal compatibility, including HTML5 web browsers).
    • Notable Variants: RasPlex, Kodi's Plex Add-on, and the Plex Client for Xbox 360.
    • Plex's Full Client List.
    • Emby's Kodi addon, repository (to install the dependencies), and Full Client List.
    • Random: Check out Rasplex, Kodi via OpenElec, Raspian, and RetroPi.
  • Or just use an High-Definition Multimedia Interface (HDMI) cable (audio + video) to connect a laptop to a TV temporarily. HDMI FAQ.

Muxing and Demuxing

Muxing and Demuxing Theory

For muxing, the idea is to take multiple discrete files (video, audio, subtitles, fonts) and merge them together into a single file for playback. For demuxing, the idea is to take one file that contains multiple streams and extract out at least one of them.

Muxing typically means shortening, lengthening or delaying streams for syncing. Shortening and delaying are compatible with stream copying techniques. However, any lengthening or modifications done mid-stream will typically require transcoding the entire stream. Thus, the two tasks (encoding and muxing) overlap somewhat.

Demuxing is usually necessary to obtain sources to work from and can be thought of as part of Capping.

The typical containers used are either Matroska (.mkv) with softsubs, fonts and possibly multiple audio streams, or standard MPEG-4 (.mp4) containers with hardsubs and a single audio stream.

Muxing tools

  • FFMPEG:
    • Read up on the following switches: -ss -t -to in the ffmpeg documentation and also this guide.
    • Use the -map switch to extract a non-first stream in multistream files. FFMPEG documentation and a related guide.
  • MKVToolNix:
    • VideoHelp Overview.
    • Download: Windows/OS-X, Linux.
    • Required Add-on: gMKVExtractGUI. Project Page and DL Link.
    • MKVMerge's CLI Documentation.
    • Advanced: Creating Multi-Part Files, Concatening Multi-Part Files.
    • Advanced: Ordered Chapters (OC) summary. Please do not use Ordered Chapters.
      • Implementation Details, Part 2.
      • To attempt to fix OCs: UnlinkMKV.
    • When working with VFR, use external timestamp files for the video bitstream.
  • DVDs:
    • DVD-Decrypter, Mega, + Stream Processing Guide. Dependencies: DVD-Decryptor needs to work from an optical device like Virtual CloneDrive or a physical DVD. If Video_TS folders are available (a.k.a. a DVD rip), then use software that can make ISO files like CDBurnerXP.
    • DGIndex, part of DGDecode, dgmpgdec158.zip.
  • BDs:
    • tsMuxer, Mega. Alternative to FFMPEG for muxing out transport streams (.ts or .m2ts) and supports parsing Blu-ray indexes (mpls).
    • HD-DVD/Blu-Ray Stream Extractor, Mega. Alternative to tsMuxer. It is recommended to use both this and tsMuxer.
    • Note: Both of the above require eac3to.
  • MKV-Cutter (untested).
  • Guides:
    • OblivionShadow's and kantai.subs.moe's Advanced SubStation Alpha Merging and Muxing Guide Guide - PDF, PDF.
    • Baal's How To: Synchronize Two Audio Tracks For Muxing With Audacity.
    • Catar's Standards of Muxed Releases. Note: The emphasis is on media server compatible dual audio releases.

Filtering

Preface

To avoid transcoding multiple times or transferring losslessly encoded video, ideally, Filtering and Encoding should be done by the same person.

Filtering Theory

Filtering tasks beyond IVTC can be thought of as an optional sub-task for encoders. Common filtering tasks include triming length, cutting out advertisements, correcting various studio mistakes and improving subjective visual quality.

Encoders that worry about compatibility may also need to hardsub OPs/EDs, or the entire script, into the video stream prior to distro. This can be done at either the Filtering or Encoding stages.

Beyond basic tasks, filtering has diminishing returns. It is very time consuming to both learn and implement.

Examples

Understanding and Identifying Artifacts

  • Understanding Video Compression Artifacts.
  • Macroblocking vs Mosquito noise.
  • Depth of Field and Hyperfocal Distance theory.
  • Understanding Camera Lenses.
    • Using the wrong color matrix while filtering can result in either "Loss of Contrast" or "Vignetting."
    • Upscaling creates "Blurring."
    • warp sharpening and stabilization create "Distortion."
    • Improper capture settings or equipment, especially for analog video, can create chromatic aberrations or "rainbowing".
  • Digital Camera Image Noise - Part 1, and Part 2.
  • Guide to Image Sharpening.
  • TODO: Haloing/Ringing, Dot crawl, rainbowing, banding*

Frameworks

AviSynth

VapourSynth

Alternative to AviSynth with many cross-compatible filters. Requires Python 3.6.

  • l33tmeatwad's VapourSynth 101 and Using Filters and Functions.
  • Official doc's installation, and Getting Started. l33tmeatwad's VapourSynth Install Guide.
  • eXmendiC's Filtering With VapourSynth, PDF.
  • Encoding from .vpy files is done using vspipe.exe. Options:
    1. See this guide.
    2. Use an ffmpeg/x264/x265 frontend like vEncode that incorporates vspipe.exe. See the "Encoding: Specific Software" section for alternatives.
    3. Interlace the .vpy in a .avs file and encode as a normal .avs file. See VapourSource.
  • Filter lists:
    • Official Plugins List (includes BM3D and waifu2x-caffe).
    • VapourSynth Evolution's Filter Index.
    • HolyWu's HAvsFunc ported function list.
    • Irrational-Encoding-Wizardry's Github Homepage. Motto: "A bunch of autists making encodes better for muggles."
    • vfrmaniac's "works" index (includes FFT3DFilter binary).
  • Vapoursynth CopyFromMe Template.
  • VirtualDub, v2:
  • Interesting History.
  • For stabalization: Deshaker, PDF.
    • Random youtube video on Deshaker
    • Todo: some sane example settings go here.

Additional programs used

  • AvsPmod, Integrated Development Enviornment (IDE) for AviSynth and VapourSynth. todo: put additional DDL link here.
  • VapourSynth Editor (vsedit), Alternative IDE for VapourSynth. Thread and Project Page.
  • Yunno = Jupyter + VapourSynth. Alternative IDE to vsedit. Additional dependencies: Jupyter and iPython.
  • Note: MPC-x86-Portable, or the 64-bit version if using AviSynth+, can load .avs files directly.
  • Waifu2x for upscaling and/or denoising.
    • See combined example results and upscaling component only example.
    • Note: Some caffe versions of waifu2x can use nvidia's CUDA Deep Neural Network (CUDNN) library instead of OpenCL/AVX. These versions are faster but require 64-bit Windows, a CUDNN capable GPU, i.e. compute capability 3.0+, and nvidia_CUDNN.dll.7z. Most versions also have a "CPU only" mode.
    • waifu2x-caffe-VapourSynth variant for VapourSynth that supports CUDA/CUDNN.
    • waifu2x-caffe-VapourSynth-w2xc variant for VapourSynth that supports OpenCL 1.2.
      • waifu2x-caffe standalone variant that supports CUDNN that can work with video as an image sequence. Important: This version also contains the /models folder required by the VapourSynth variants above.
      • waifu2x-converter-cpp and DeadSix27's Fork is an older CLI standalone (no framework) CUDA/OpenCL/AVX implementation. koroshell GUI.
      • AutoWaifu.

Further reading

  • kageru.moe/blog/encode and Abstract Javascript Video Filtering.

Scene Filtering

This is an optional subcomponent of filtering which is an optional sub-component of encoding, which is an optional sub-component of capturing. In other words, stay away.

  • Basic: frameTools's sceneFilter(). See the documentation and releases page.
  • More efficient and recommended: tp7's Efficient scenefiltering with AviSynth, PDF.

Working with Groups of Pictures (GOPs)

Scene filtering can also be done in Photoshop or Gimp one frame at a time. Manually editing each frame could be described as an optional component of scene-filtering.

Mandatory reading: Understanding FFMPEG's Group of Pictures (GOP) Options.

  • Cambridge colour's Photo Editing Tutorials and Digital Photo Restoration.
  • Adobe's Photoshop Retouch and repair photos user guide.
  • Panorama basics and How to Auto-Align Layers. Useful for later reanimating panning scenes in Premiere.
  • Example: Maybe-not-so-sane workflow diagram.
  • Special Note: When converting between YUV and RGB, double-check for color distortions manually through every step in the workflow where colorspace conversions between color families occur. This especially applies to denoising algorithims like waifu2x and BM3D (including when using it inside of mvsfunc's wrapper).
  • Exporting/Importing Images:
    • FFMPEG image sequence guide 1, guide 2, guide 3.
      • ffmpeg -i myvideo.mkv "output\out_%06d.png" #Defaults to rgb24 output and will convert VFR to CFR.
      • ffmpeg -i myvideo.mkv -pix_fmt rgb24 "output\out_%06d.tif" #Specify a colorspace with tif or will export native yuv.
      • ffmpeg -r 24000/1001 -i "out\op-%06d.tif" myvideo.mkv #Always use -r to specify input framerate for image sequences.
      • ffmpeg -r 30000/1001 -i "out\op-%06d.png" -c:v huffyuv myvideo.mkv #Encode losslessly.
      • ffmpeg -r 30000/1000 -i "out\ed-%05d.png" -crf 0 myvideo.mkv #Encode losslessly (h264).
    • VirtualDub "File-Open video file...," or "File-Export-Image sequence..." (not recommended).
    • mplayer example and see the -vo "jpeg" or "png" section of MPlayer's Video Output Drivers (MPlayer Only) documentation (not recommended).
    • AviSynth:
  • Image Viewers: InfranView or your favorite graphical HTTP client.
  • For batch image procesing: Photoshop Macros, ImageMagick (very advanced) and waifu2x-caffe.

Masktools

  • Masktools, PDF, provides an efficent way to select parts of a video frame but not others. If combined with other concepts, like motion compensation and edge detection, masktools allows filters to selectively target aspects within a frame for many consecutive frames. Neither scene filtering techniques, which are clip-based, nor image editing techniques allow for the flexibility and efficency that Masktools can provide.
  • tp7's MaskTools 2 theory, PDF.
  • tp7's MaskTools for beginners and generally: Translation from Russian: PDF. Original link:
    • http://web.archive.org/web/20160312025423/http://tp7.ruanime.org/masktools/index.html
  • 06_taro's MaskTools guide. Translation from Chinese PDF - Page 1 and PDF - Part 2.
  • Further reading: Edge Masks in Vapoursynth by Kageru.

Real-time filtering

The idea is to get playback without having to transcode the video.

  • SmoothVideo Project (SVP), example, for frame interpolation to 60fps. Note: Avisynth/Vapoursynth plugins also available.
  • Media player GPU accelerated "shaders": MPC-HC, [mpv]. Includes sharpening and scaling filters.
  • MadVR has quite a few.
  • With a powerful enough computer and a computationally light enough filter chain, .avs files (AviSynth) can be played directly.

Translating (TL) + Translate Check (TLC)

  • Transliterating: Change the words (and maybe grammar) to a new language. vs
  • Translating: Change what was said, including metaphors, to convey the same meaning.

Timing, Fine Timing, Scene Timing, Key Frame Timing (KFT), Karaoke Timing (KT)

  • Timing theory, PDF by Collectr.
  • unanimated's Timing Basics, Timing Without TPP and additional notes. unanimated's Guide Index: PDF.
  • Doki's Timing Guide, PDF.
  • Sally's Sally's Guide To Timing Anime, PDF, GDrive - PDF.
    • Resources: GoogleDrive: Sally's Timing Video, Sallys Timing Example, picture 1 and picture 2.
  • WhyNot's A Guide to Timing in Aegisub, PDF.
  • m33w-fansubs's Timing & Styling Guide.
  • unanimated's How to make xvid keyframes.
  • For K-timing, if you do not have the romanticized Japanese syllables memorized already, save these Hiragana character maps: 1 and 2.
  • Random YouTube videos:
    • Jude Ibe, Dozo Douzo, and Govna.

Editing + Quality Check (QC)

  • Editing: Editors make sure the translation can be easily understood, sounds natural, is consistent and either localized or unlocalized (depending on preference).
  • The only requirement for editing is the one must speak the target language fluently, which can be a high bar.
  • Personally, I also listen to the foreign audio to make sure the post-edited dialogue stays as literal as possible and make sure the dialogue word choice and typesetting are compatible with speed reading techniques.
  • Random: For comprehension, it deosn’t enve mttaer in waht oredr the ltteers in a wrod are bscsaue the hamun brian is well adeptad to roecginze pettarns. Speed reading is the same concept, but applied to sentences instead of individual words. With "visual reading" in English, shorter words (to, a, be, are, by) are grammar that can be skipped by parsing only the longer words. Any "missing" meaning is derived from context. Try reading by skipping all the smaller words. If the sentence does not make sense, change the order and words used so it does make sense. Within this context, contractions are evil.
  • tun's Fansub Editing Guide, PDF.
  • Collectr's editing tips:
    • Curmudgeonly Guide to Editing, PDF.
    • Editorial Minimalism, PDF.
    • The Dangers Of Second Hand Translations, PDF.
  • Important: Figure out what type of editing you like. 1) Standard-Informal English, 2) Unlocalized literal, or 3) Localized memesubs. PNG GUIDE. Summary:
    1. Unlocalized-Literal: Doki/Eclipse.
    2. Official Standard or Informal English: Crunchyroll, Funimation, official DVD-BD are a close second.
    3. Localized: Commie/DesuYo/FFF are heavily localized memsubs. Avoid unless you knowingly like localization. They are good sources for sign typesetting when combined with dialogue from 1-2 above.
    4. Hadena subs are so not even funny to the point where it is not even not funny anymore and becomes funny again.
      • Note: The point here is not to comment on Hadena, but rather as to counter editorial minimalism. If the subs are good, leave them alone, but if they are really bad, then change everything.
    5. A lot of remuxers combine existing subs with better/worse Audio and Video (A/V). The subs quality is usually the same as whoever they ripped them from.
    6. Censoring exists (sex-gore), in both dialogue and in A/V. Be wary of this from broadcast streams, especially non-Japanese ones, including older DVDs.
  • Use Crymore's Translation Parties to figure out what type of editing you like, start with this one. They take a while but will save time later on by being able to start from "better" subs and having to edit them less overall.
  • Blog about fansub drama and editing: crymore.net.
  • QC: Collectr's Curmudgeonly Guide to QC.

Typesetting

Styling Theory

In summary:

  1. Use white as the primary color.
  2. Have a very dark border (black).
  3. Use a readable font, like Arial or Roboto, in bold.
  4. Make it large enough to see without squinting.

Styling Links

Check out Underwater's Styling Guide [PDF].

Typesetting Theory

Typesetting is mostly making sure the subtitle dialogue is visually legible and signs look like they are natively part of the video. Typesetting can also extend to styling the opening, ending and insert songs, including fancy karaoke.

More theory. The most important part of typesetting is also the simplest: make sure the dialogue is readable.

While Typesetting is actually quite strait-forward, doing it efficiently and well is something else entirely.

Typesetting Links

  • unanimated's Guide to Typesetting in Aegisub, RAR, RAR mirror, PDF.
  • unanimated's Aegisub scripts, PDF and Typesetting Tools. iamevn's mirror.
  • Commie's Typesetting in Aegisub, PDF and Scripts for Aegisub - ZIP.
  • Mocha, as mentioned in the guides above, can be used for motion tracking signs. A basic version of Mocha is also included natively in Adobe After Effects 11 (CS6) and newer.
  • lyger's Aegissub Automation Scripts.
  • A short guide on Gradients.
  • Aegisub-Motion and a guide.
  • Creative typsetting ideas: maxfireheart.blogspot.in.
  • Advanced: Koby's ASS Draw Shapes used for typesetting and KFX.
  • Advanced: Typsetting With Adobe Illustrator by Line0 and related Blog.

Karaoke Effects (KFX)

Theory: This is an optional subcategory of typesetting that adds additional special effects to karaoke. Usually, KFX refers to effects beyond simple k-timing. KFX can be added to k-timed lines by applying a KFX template, modifying existing effects, or creating new effects.

Some KFX can exist in softsub.ass but others must be pre-rendered (hardcoded) either because the tool to create them draws on the video stream directly, independent of k-timing, or because dynamically rendering the effect would cause severe stuttering during playback.

As with all typesetting, applying KFX can actually be quite strait-forward, but creating and modifying new and visually appealing KFX is something else entirely. More intro.

Prerequisite reading

Working with templates

Kara Effector

Kara Effector is a lua plugin for Aegisub that focuses on modifying provided templates. It has a lot of them and basic modifications (shapes, colors, duration, quantity) are strait-forward. Most of the documentation, PDF, is in Spanish.

  • Kara Effector 3.4 for Aegisub 3.2.2: Mediafire, Mega (subtitles-kfx-Kara Effector) and the older 3.3 version
  • Kara Effector Usage Guide (1-39): Chapter PDFs available on Mega, or see this combined PDF (1-39).
  • Youtube installation video, Facebook page, Youtube homepage and some examples.
  • Random KE formatted KFX: Mega 1 and 2, KFX_Archive_May17.zip (subtitles-kfx-Kara Effector).

Creating KFX

Distribute (Distro)

#1: Torrents

  • Basic: Introduction to BitTorrent Protocol, Beginner's Guide, WikiBooks, Wikipedia.

  • Technical: BitTorrent in Detail, Specification, and BitTorrent Enhancement Proposals (BEPs).

  • Client Side:

    • Recommended: qBitTorrent. Cross-platform cross-architecture and open source.
    • Windows only alternative: uTorrent 2.2.1 (this exact version).
    • Port Forwarding: theory and related guide.
    • Creating Torrent Files:
      • BakaBT's How to create torrent files, PDF.
        • For a standalone utility to create torrents, see dottorrent-gui.
        • This utility also supports AnimeBytes's "Source" property extension.
        • Creating torrents faster with a CLI (advanced) py3createtorrent, DL link.
        • Requires Python 3.1+ by default, but it is possible to use pyinstaller to compile it into a native binary (.exe).
    • After that, upload myfile.torrent to some website. This will register it or start the registration process with the tracker if necessary. Give it a description so other peers know what you are offering.
    • For automatic torrent submission:
      • Seiya's Anidex Torrent Uploader: Kametsu thread and Github.
      • Golumpa's AniDexPy. A simple Python tool for uploading to AniDex via its API.
    • Note: This only distributes the meta-file. For the distribution of the content, use a seedbox.

  • Seedbox Theory:

    • Seedboxes are servers that provide BitTorrent services. They can be implemented locally or rented commerically.
    • As per Introduction to BitTorrent Protocol, any BitTorrent client-side software can potentially be used as seedbox software.
    • Commercially, the most popular client to use for Seedbox SaaS offerings is rTorrent, rTorrent ArchWiki, with the ruTorrent frontend.
    • Reddit/r/Seedboxes.
    • For information on setting up a local seedbox please see "Distro For Do It Yourself (DIY) People".

  • BitTorrent Tracker Theory:

    • Since backend tracker software is meant to be always active on high performance connections and require constant maintenance, it is not recommended to run one. Use existing trackers instead. However if interested, read this: BitTorrent Tracker Theory.
    • There are also a number of low capacity PHP trackers designed for PHP enabled web servers and standalone tracker software executables intended to be run temporarily.

  • Misc Tutorials and Guides.

#2: Hyper Text Transport Protocol (HTTP) (+ Transport Layer Security (TLS))

  • Client:
    • Firefox ESR with this.
    • Firefox forks: Palemoon, or Waterfox.
    • Chrome.
    • Note: For the graphical HTTP clients above, always use uBlock Origin.
    • CLI: Aria2c, wget or cURL.
    • Mega Downloader v1.7, Mega. Sometimes bypasses Mega's download restrictions. SHA1 hash: D8C14D88F6C8B35FDD79CD7D208D818C4683E224
    • JDownloader2 Supports automatic resuming of HTTP connections (downloads) with many site-specific plugins available. Required for certain German DDL sites/forums.
  • File Server Cloud - Direct Download (DDL):
    • Cloud storage providers like Mega provide substantial but limited duration storage.
    • Anime Tosho mirrors the contents of English translated torrents on Nyaa and TT to cloud storage providers.
    • Amazon, Google, and Microsoft provide limited long-term storage at affordable rates.
    • If you own or do not mind purchasing a domain, consider Google's G Suite for cost effective cloud storage.
  • Web Server Cloud:
    • See: "Misc: The Group Blog."
  • Selfhosting (HTTP):
    • See "Distro: Seedboxes" and "Misc: Distro For DIY People" sections.

#3: Internet Relay Chat (IRC)

  • Protocol Theory: IRC and Kludges.
  • Guides: Flash Squirrel's How to Download using IRC, Kametsu's IRC Tutorial Index, and IRC client installation tutorials for Windows and OS/X.
  • Clients: Comparison of IRC Clients.
    • Preferred: Hexchat, previously known as "xchat", is open source, cross platform and supports limited scripting.
    • KVIrc, open source, cross platform, and astheticly pleasing. nightly binaries.
    • AdiRC, closed source freeware, cross platform, many themes available.
    • mIRC, proprietary and Windows only, but has powerful scripts available (e.g. to FServe). Idiot Proof Installation Guide.
    • There are also a number of web-based and mobile (iOS/Android) IRC clients that do not support DCC.
  • FServers
    • Client: Keiichi's Fserve Guide, Microsoft Office Document (doc), WikiBook's Fserve Guide.
    • Server: mIRC FServer Setup Script and a random guide.
  • XDCC

File Transfer Protocol (FTP)

  • No. This protocol needs to die. Use HTTP instead.

Newsgroups

  • TODO: stuffs goes here.

Random Distro Tools

  • CRC32: Used to put the CRC32 in brackets at the end of the filename (e.g. myfile_[1BA919D7].mkv):
    • RapidCRC (preferred).
    • GUI alternative: Anime Checker.
    • CLI alternative 7z h documentation.
      • bash script.
  • Avdump2 Based on MediaInfo. This is used to quickly update AniDB.net. See:
    • AniDB Wiki Tutorial and Prolix Addendum, Mirror.
  • line0's Solutions For Taking Screenshots, todo: [PDF].
  • Screenshot comparison sites:
  • Patches
    • Theory: "Patches" are small scripts that take an existing file, a difference file (patch.vcdiff) and create a new file based on those differences. More theory: Patches and xdelta3.
    • Guides:
    • moodkiller's xdelta3 GUI.
    • BakaBT's Patching Guide.
    • 13ack.Stab's Guide to V2 Patches.
    • Using patches: a simple example FFF's Mirai Niki 7 - Patch and some complicated examples.
    • To create a patch:
      • CLI: xdelta3 -e 9 -s old_file new_file delta_file
      • Or xdelta3 GUI for GUI people. Also see: Moodkiller's xdelta3 rebooted fork.
    • A binary version of xdelta3.exe can be obtained from the above patch examples or from xdelta3 GUI.

The Group Blog

  • Theory: Provide a way to centralize knowledge about your group including the following:
    • Latest release information, project archive, download options (Torrents/HTTP/XDCC/fserve), contact information (IRC/Email), community feedback mechanisms (chatbox), declared waifus, guides for the community, and donation solicitation.
  • Getting Started:
    1. (optional) Read The Internet and Hosting Providers to know how the internet works and how much services cost.
    2. (optional) Purchase a mygroup.moe domain from Hover for ~$20 (yearly). Alternative registrars: get.moe.
    3. Start a blog on Blogger or Wordpress.
      • Note: Wordpress and Weebly charge for custom domains and Blogger will disable TLS.
    4. Post releases. Example.
  • Markdown (formatting for blog posts):
    • Markdown Cheatsheet.
    • Markdown Preview, v4, and HTML converter.

Distro For Do It Yourself (DIY) People

General Mandatory Reading

  • The Internet and Hosting Providers.
  • Port Forwarding theory and related guide.
  • Setting Up A Server (including a VPS) and Security Policy.
  • Using Crontab Guide 1 and Guide 2 to start tasks at startup. See: this example.

DNS/Dynamic DNS (DDNS)

Raspberry Pi

  • raspberryPi, Documentation and Ebay Search Link.
  • Hint: Use external storage over USB instead the Secure Digital (SD) card internal storage.
  • Be sure to set up Remote Access: SSH, VNC, (and maybe) Samba.

Seedbox Software

  • rTorrent with the ruTorrent frontend is popular due to very low resource utilization and high performance. Installations and management are usually automated:
    • Quickbox, Github (recommended).
      • Only works for x86_64 on certain Ubuntu/Debian versions:
    • arakasi72's "rtinst" for Debian and Ubuntu: Github. Note: I have not tested this.
  • qBittorrent, Wiki, is cross platform and cross-architecture.
    • sudo apt-get install -y qbittorrent
    • Or compile it to get the latest v3.x version: official compiling documentation, arm7 compile instructions and Banana seedbox. v4.x requires QT5. Have fun.

HTTP File Server

  • List of Static HTTP Server Software.
    • Consider using the asynchronous "HTTP-Server" implemented using Node.js. See: this guide.
  • Apache and Nginx have various issues recursively auto-indexing mounted Fat32 formatted volumes via directory junctions. Just FYI~

TLS

  • For encryption check out stunnel: Features List, this install guide.
  • For authentication check out LetsEncrypt and the following resources: the EFF's Certbot, stunnel's LetsEncrypt configuration and this guide on Configuring Cipher Suites Correctly.
    • Also see this TODO: [TLS combined guide].
  • Use SSL-Lab's SSL Server Test to verify the configuration once everything is set up.

Remux

Remuxers typically focus on improving work done by other groups, combining work done by multiple groups and/or combing subs with better Audio/Visual (A/V) sources.

Subtitle Preprocessing Tools

  • Sushi's Audio Based Subtitle Shifter. Guide.
  • eXmendiC's timing script. Note: I have not tested this.
  • Notepad++. Supports "Find and Replace" across many files simultaneously.
    • py3stringReplace. Automated version of Notepad++'s "Find and Replace".
  • Aegisub's Timing Post Processor (TPP).
  • Kageru's snap_scenechanges.py.
  • iamevn's combine_lines.py.

Workflow

  1. Obtain raws (See: Capping).
  2. Obtain scripts.
    1. Find out which groups did the series:
      • Anime DataBase (AniDB).
      • Search Nyaa, Anidex.moe, bakabt, etc.
      • Shortcut: AnimeTosho's "Attachments" section.
      • ar-fansub-db.blogspot.com and arfansubdb.com (Arabic, Hint: Use Chrome's translation feature.).
    2. Obtain the subs or files.mkv from the group.
      • Check their website for HTTP or torrent links.
      • Check the BitTorrent tracker the group uses.
      • Check their IRC channel and look for an XDCC bot.
      • If you can find out the exact name of their files, use @find in rizon.net's #news and give it to Google.
      • Ask the group over IRC or email (unlikely to work).
      • This one russian site sometimes has scripts.
        • Use Notepad++ to change the character encoding to UTF-8 if necessary.
    3. If you can obtain the files.mkv, then stream copy or extract them out. (See: Muxing)
  3. Fix any issues (like localizations and syncing issues) (See: Filtering, Encoding, TLC, Editing, Timing, Typesetting).
  4. Mux to preserve the changes (See: Muxing).
    • It is considered rude to use an existing groups tag in the filename, even if only minor changes were made. Use any other tag, none, a throw-away one, or your own nickname. To give them credit, label the tracks with the original source group name and credit them in any descriptions.
    • Remember to put the CRC32 in [ ] at the end of the filename (e.g. myfile_[1BA919D7].mkv). (See: Random Distro Tools for details.)
  5. Distro (See: Distro).

In Service of Chaos: Analog

Digital is an exercise in precision, while analog was an exercise in controlled chaos." -digitalfaq.com, Forums.

Analog Video Broadcasting History (fascinating btw)

  • Presentation slides on Analog Communication Systems.
  • YouTube videos:
  • Technology Connections (YouTube channel).
    • Before electronic television, there was Mechanical Television.
    • Philo Farnsworth and the Invention of Electronic Television.
    • Lines of Light: How Analog Television Works.
    • How Analog Color TV Works The Beginnings, Part 2: Compatible Color and Part 3: more stuff.
    • These Are Not Pixels: Revisited.
    • Trinitron: Sony's Once Unbeatable Product.
      • Why is TV 29.97 frames per second?

Analog Decoding and Artifacting

Consumer Media Overview and Resources

  • Wiki on video: Composite, S-Video, Component.
  • Wiki on audio: TODO: stuff here.
  • Interesting case study.
  • VHS: Up to 3 Mhz of analog video on magnetic tape with 240 lines of resolution.
    • VHS Player User Manual Index.
    • YouTube videos:
    • The Impossible Feat inside Your VCR.
    • Why Sony's Beta Videotape System Failed: Part 1 and Part 2.
    • Comparing Beta and VHS.
  • Laserdisc: Up to 5 Mhz of analog video on a digital disc with 400-425 lines of resolution. Supports CD quality digital audio, and sometimes encoded AC3 or DTS.
    • Forums and reddit. Related library.
    • Youtube Videos:
    • Laserdisc: An Introduction.
    • Laserdisc's Failure: What Went Wrong.
    • Laserdisc: Features, Follies & Evolution.
    • DVD: The Death Knell of Laserdisc.
    • MUSE Hi-Vision Laserdisc: The Blu-ray of 1994.
    • The most boring video ever on optical media and Laserdiscs: Pioneer's Video Tuning Fork volume 1. Please skip this one.
    • Further viewing: Overview of the Pioneer CLD-M301.

Analog Capture Guides

The idea is to digitize the analog audio and video signals.

← Metadata

31
Stars
3
Forks
Watchers

Owner

verified publisher icon zeriyu

Metadata

Fork from https://gist.github.com/YukinoAi/acea024631a2585aa592b16b4bde959f

Back