Arch Linux Guide
1.0.0
注：この便利な拡張機能マークダウンPDFを使用して、このマークダウンファイルをVSCODEのPDFに簡単に変換できます。
はじめる
ソフトウェアを取得します
ゲーム
MacOSワークスペースをセットアップします
Windows 10ワークスペースをセットアップします
LinuxでAndroidおよびAndroidアプリを使用します
プロのオーディオ/ビデオ編集
Kubernetes
機械学習
ロボット工学
オープンソースのセキュリティ
DevOps
フラッター開発
ネットワーキング
データベース
gnome拡張機能
高度なトピック
Arch Linuxは、独立して開発されたx86-64汎用GNU/Linux分布の汎用性があらゆる役割に適しています。開発は、シンプルさ、ミニマリズム、コードエレガンスに焦点を当てています。アーチは、ユーザーが独自の目的で必要または望ましいもののみをインストールすることにより、独自の理想的な環境が組み立てられる最小限のベースシステムとしてインストールされます。
Archwikiは、Web上のArch Linuxドキュメントの最良のソースです。
WSLのArch Linux（Linux用のWindowsサブシステム）
Etcherは、オープンソースのクロスプラットフォームソフトウェアであり、MicroSDカードまたはUSBデバイスにオペレーティングシステムの画像を簡単にフラッシュできます。
Manjaro Linux
エンデボウロス
Gauruda Linux
Arcolinux
Steam OS 3.0は、KDEプラズマデスクトップを使用した不変のオペレーティングシステム（OS）です。これにより、ルートファイルシステム上ではなく、フラットパックを使用してコンテナにアプリケーションをインストールできます。これは、アプリケーションのインストールがコアファイルシステムから分離されているだけでなく、悪意のあるアプリケーションがシステムを妥協/破損する能力が大幅に削減されることを意味します。
https://aur.archlinux.org/gnome-tweaks-git.git
ターミナルを開いて実行します。
sudo pacman -S gnome-tweak-tool //let ' s you customize your desktop layout. Pop Shellは、Windowsの迅速かつ賢明なナビゲーションと管理を可能にするGnomeシェル用のキーボード駆動型レイヤーです。ポップシェルのコア機能は、I3WMと同様の高度なタイル張りウィンドウ管理を追加することです。
https://aur.archlinux.org/packages/gnome-shell-extension-pop-shell-git.gitファイアウォールを使用します
ターミナルを開いて実行します。
sudo firewall-cmd --state
sudo systemctl status firewalldトップに戻ります
Arch Linuxユーザーリポジトリ（AUR）には、Arch Linux MakePKGアプリケーションを使用して、ソースから68,000近くのインストール可能なパッケージをコンパイルするために、数千のビルドスクリプトが含まれています。
注1：このソフトウェアはすべて、Debian、Linux Mint、Elementary OS、Fedora、Manjaro Linux、Endeavouros、Arch Linuxなどの他の人気のあるLinuxディストリビューションでも利用できます。
App Outletは、Linux App Store Online Serviceに触発されたユニバーサルアプリケーションストア（フラットパーク、スナップ、アピメージ）です。
sudo pacman -S flatpakFlathubは、Flatpakアプリケーション向けのビルドおよび流通サービスです。
Flathubフォーラム
Arch Linuxにスナップをインストールします
Snap Storeは、SNAPアプリケーション向けのビルドおよび流通サービスです。
スナップクラフトフォーラム
AppimageHubは、Appimageアプリケーション向けのビルドおよび流通サービスです。
Appimage Managerは、Appimagesのパッケージマネージャーです。
アピメージフォーラム
トップに戻ります
Archwikiの蒸気
Steamフラットパック
Protonは、Windows専用のゲームがLinuxオペレーティングシステムで実行できるようにするSteamクライアントで使用するためのツールです。ワインを使用してこれを容易にします。
ProtOndBは、LinuxでProtonでゲームをテストし、ゲームのパフォーマンスの総合的なスコアを提供するため、他のゲーマーからの100,000を超えるゲームレポートのコレクションです。増え続ける提案は、Protonが開発を続けている間、ゲームを機能させることができる微調整を提供します。これに加えて、このサイトのSteamゲームカタログを探索して、Linuxで使用することができなかった幅広いタイトルを閲覧および発見することができます。
Lutrisis Linuxのゲームクライアント。現在のコンソール生成を除き、すべてのビデオゲームにアクセスできます。また、GOG、Steam、Battle.Net、Origin、Uplay、および既存のゲームライブラリとコミュニティの保守スクリプトをインポートできる他の多くのソースなど、他の多くのソースなど、完全に自動化されたセットアップを提供する他のストアとうまく統合します。
壮大なゲームストアを追加します
GameHubは、すべてのゲームの統一ライブラリです。これにより、ゲームをさまざまなプラットフォームから1つのプログラムに保存して、ゲームを管理しやすくすることができます。
GameHubサポート：
Linuxのネイティブゲーム
複数の互換性レイヤー：
複数のゲームプラットフォーム：
GeForceはChromebookバージョンを使用して、Google ChromeまたはBrave、Vivaldi、Microsoft EdgeなどのChromiumベースのWebブラウザーですべてのゲームを再生します。また、Snap Store GeForceの電子デスクトップアプリとしても利用できます。
Moonlight Game Streamingは、構成が不要でインターネット上でPCゲームからストリーミングできるプログラムです。あなたが別の部屋にいるか、ゲームリグから何マイルも離れているかどうかにかかわらず、ほぼすべてのデバイスからストリーミングします。
Chiakiは、Linux、FreeBSD、OpenBSD、Android、MacOS、Windows、Nintendo Switch、およびさらに多くのプラットフォームのPlayStation 4およびPlayStation 5のリモートプレイ用の無料でオープンソースソフトウェアクライアントです。
Xbox Project XCloudは、MicrosoftのクラウドベースのXboxゲームストリーミングテクノロジー（現在ベータ版）です。 Forza Horizon 4、Halo 5：Guardians、Gears of War 4、Sea of Thieves、Cuphead、Red Dead Redemption 2、およびMobile DeviceまたはChrome Webブラウザーの100以上のゲームなどのゲームをプレイします。 MicrosoftのXbox Project XCloudには、XboxゲームパスUltimateサブスクリプションが必要です。
Retroarchは、エミュレーター、ゲームエンジン、メディアプレーヤーのフロントエンドです。滑らかなグラフィカルインターフェイスを介して、幅広いコンピューターとコンソールでクラシックゲームを実行できます。設定も統一されているため、構成は完全に行われます。
Dolphinは、最近の2つの任天堂ビデオゲームコンソールのエミュレータであるGameCubeとWiiです。これにより、PCゲーマーは、すべてのPCコントローラーとの互換性、ネットワークマルチプレイヤーなど、いくつかの強化を備えたフルHD（1080p）のこれら2つのコンソールのゲームを楽しむことができます。
Citraは、お気に入りのゲームの多くをプレイできるニンテンドー3DSのオープンソースエミュレーターです。
Yuzuは、Citraの作成者からのNintendo Switchの実験的なオープンソースエミュレーターです。
Dosboxは、主にDOSゲームの実行に焦点を当てたオープンソースDOSエミュレーターです。
Mameはアーケードマシンエミュレータです。
XemuはオリジナルのXboxエミュレータです。
Greenwithenvy（GWE）は、Roberto Leinardiによって設計されたGTKシステムユーティリティであり、情報を提供し、ファンを制御し、NVIDIAビデオカードをオーバークロックしてパフォーマンスを向上させます。フラットパックとしてポップショップで利用できます。
CorectRLは、ネイティブおよびWindowsアプリケーションのアプリケーションプロファイルを使用して、コンピューターハードウェアを簡単に制御できる無料のオープンソースLinuxアプリケーションであり、基本的なCPUコントロールと完全なAMD GPUコントロール（古いモデルと新しいモデルの両方）を備えています。
イェーイと一緒に、実行してください：
yay -Sy corectrl
Geekbench 5は、ボタンを押すことでシステムのパフォーマンスを測定するクロスプラットフォームベンチマークです。
ユニジンの重ね合わせは、PCハードウェアの極端なパフォーマンスと安定性テスト、ビデオカード、電源、冷却システムです。
ワイン（ワインはエミュレータではありません）は、Linux、MacOS、BSDなどのいくつかのPOSIX準拠のオペレーティングシステムでWindowsアプリケーションを実行できる互換性層です。ワインは、仮想マシンやエミュレータのような内部Windowsロジックをシミュレートする代わりに、Windows API呼び出しをFlyでPOSIX呼び出しに変換し、他のメソッドのパフォーマンスとメモリのペナルティを排除し、Windowsアプリケーションをデスクトップにきれいに統合できるようにします。
トップに戻ります
要件
ターミナルを開いて実行します。
sudo pacman -S qemu uml-utilities virt-manager dmg2img git wget libguestfs-tools p7zip Sosumiは、VMにMacOSをダウンロードしてインストールできるアプリです。 APPはMacOS-Simple-KVMに基づいています。
MacosのOpencore
トップに戻ります
要件
ターミナルを開いて実行します。
sudo pacman -S qemu uml-utilities virt-manager gnome-boxesGnome Boxesは、仮想マシンにアクセスできるアプリケーションで、ローカルまたはリモートで実行されます。また、リモートコンピューターの表示に接続することもできます。
Windows 10のOpenCore
トップに戻ります
Android Studioは、GoogleのAndroidオペレーティングシステム（OS）の開発スイートです。 JetBrains Intellij Ideaソフトウェアに基づいて構築されており、Android開発専用に設計されています。 Windows、MacOS、Linuxでダウンロードできます。
Android Virtual Device（AVD）は、Android携帯電話、タブレット、Wear OS、Android TV、またはAndroidエミュレータでシミュレートしたいAutomotive OSデバイスの特性を定義するAndroid Studioの構成です。 Androidエミュレーターは、コンピューター上のAndroidデバイスをシミュレートするため、各物理デバイスを使用する必要なく、さまざまなデバイスおよびAndroid APIレベルでアプリケーションをテストできます。
Lineageosは、Androidモバイルプラットフォームに基づいた、さまざまなデバイス用の無料のオープンソースオペレーティングシステムです。
Anboxは、Ubuntu、Debian Fedora、OpenSuseなどの通常のGNU/Linuxシステムで完全なAndroidシステムを起動するためのコンテナベースのアプローチを提供するアプリケーションです。
Anbox Cloudは、Canonicalが提供するモバイルクラウドコンピューティングプラットフォームです。クラウド、ハイスケール、およびあらゆる種類のハードウェアでAndroidを実行します。
Genymotionは非常に高速なAndroidエミュレーターです。プログラム自体はVirtualBoxに基づいており、効果的に高速で知られており、Windows、Mac、LinuxデスクトップでAndroidアプリを実行するのに有用です。
デスクトップ
パフォーマンスが高いローカル仮想デバイス。
SCRCPYは、USBで接続されたAndroidデバイスの表示と制御を提供するGenymotionによるアプリケーションです（またはTCP/IPを超えて）。ルートアクセスを必要とせず、GNU/Linux、Windows、MacOで動作します。 Androidデバイスには、少なくともAPI 21（Android 5.0）が必要です。
トップに戻ります
H.264（AVC）は、最大8kのサポートを備えた複数のプロファイル（ツール）とレベル（最大ビットレートと解像度）を定義するブロック指向およびモーション補償の整数DCTコーディングに基づくビデオ圧縮標準です。
H.265（HEVC）は、H.264（AVC）の後継者であるビデオ圧縮標準です。同じレベルのビデオ品質で25％から50％のデータ圧縮、または同じビット率でビデオ品質を向上させます。
FFMPEGは、人間や機械が作成したほとんどすべてのものをデコード、エンコード、トランスコード、MUX、Demux、Stream、Filter、および再生できる主要なマルチメディアフレームワークです。これは、Windows、MacOS、Linuxなどの複数のプラットフォーム上の最先端の形式まで、最もあいまいな古代形式をサポートしています。
Handbrakeは、広くサポートされているコーデックを選択したほぼすべてのフォーマットからビデオをトランスコーディングするためのツールです。ウィンドウ、MacOS、Linuxでサポートされています。
HTTP（DASH）を介した動的な適応ストリーミングは、ビデオを再生し続けるために、ビデオストリームがネットワークパフォーマンスに基づいてビットレートを切り替えることを可能にする適応ストリーミングプロトコルです。
OpenMax™は、加速されたマルチメディアコンポーネントを複数のオペレーティングシステムとシリコンプラットフォームで開発、統合、プログラムできるようにすることにより、包括的なストリーミングメディアコーデックとアプリケーションポータビリティを提供するクロスプラットフォームAPIです。
Davinci Resolveは、プロの8K編集、色補正、視覚効果、オーディオポストプロダクションをすべて1つのソフトウェアツールに組み合わせた世界で唯一のソリューションです！編集、色、エフェクト、オーディオの間で1回のクリックですぐに移動できます。 Davinci Resolve Studioは、マルチユーザーコラボレーション用に設計された唯一のソリューションでもあるため、編集者、アシスタント、カラリスト、VFXアーティスト、サウンドデザイナーはすべて、同じプロジェクトで同時にライブで作業できます。
Blenderには、組み込みのビデオシーケンスエディターが付属しているため、ビデオカットやスプライシングなどの基本的なアクションを実行できます。また、ビデオマスキングやカラーグレーディングなどのより複雑なタスクを実行できます。ビデオエディターには、ライブプレビュー、Luma波形、Chroma Vectorscope、およびヒストグラムディスプレイが含まれます。オーディオミキシング、同期、スクラブ、波形の視覚化。
Kdenliveは、無制限のマルチメディアファイルをサポートするオープンソースビデオ編集ツールです。 MLTフレームワーク、KDEおよびQTに基づいています。機能が満載の非常に多用途のビデオ編集ツールを探している人。最新の20.08リリースは、インターフェイスレイアウト、複数のオーディオストリームサポート、Cachedデータ管理、クリップモニターとエフェクトパネルのズームバーなどの気の利いた機能を備えていますが、このリリースのハイライトは安定性とインターフェイスの改善であると主張する場合があります。
OpenShotは、編集環境で新しいユーザー向けに設計されたオープンソースビデオ編集ツールです。シンプルなドラッグアンドドロップ機能などのシンプルな機能があり、使いやすく迅速なラーンユーザーインターフェイスを提供します。強力なビデオエディターは、ビデオをカットしてトリミングするための効率的な方法をたくさん提供しています。無制限のトラック、ビデオエフェクトエンジン、タイトルエディター、3Dアニメーション、スローモーション、および時間効果を自由に利用できます。 WebM（VP9）、AVCHD（LIBX264）、HEVC（LIBX265）、MP3（LIBMP3LAME）やAAC（LIBFAAC）などのオーディオコーデックなどのFFMPEGによってサポートされる一般的に使用されるビデオコーデックをサポートします。このプログラムは、YouTubeなどのインターネットビデオWebサイトにアップロードするためのMPEG4、OGV、Blu-ray、DVDビデオ、およびフルHDビデオをレンダリングできます。
Lightworksは、映画業界が使用するデジタルビデオの編集とマスタリングのための非線形ビデオ編集アプリケーションです。そのプロフェッショナル版は、シャッターアイランド、パルプフィクション、ミッションインポッシブルなどの興行収入に使用されています。威圧的なユーザーインターフェイス。 Adobe Premiere Proなどのプロのビデオ編集者と同様に、LightWorksは新しいユーザーに使用するのがかなり複雑です。
ShotCutは、オープンソースのマルチプラットフォームビデオエディターです。ビデオ編集（4Kビデオ品質を含む）、エフェクトの追加、新しい映画の作成、ほとんどの画像ファイル形式のインポート、ほぼすべてのファイル形式へのエクスポートなど、さまざまなアクションを実行できます。
Oliveは、ハイエンドのプロフェッショナルビデオ編集ソフトウェアの完全に食事を提供する代替品を提供することを目的とした無料の非線形ビデオエディターです。
OBS（Open Broadcaster Software）は、ビデオ録画とライブストリーミング用の無料でオープンソースソフトウェアです。 Twitch、YouTube、その他多くのプロバイダーにストリーミングしたり、高品質のH264 / AACエンコードで自分のビデオを録音したりします。
Reaperは、コンピューター向けの完全なデジタルオーディオ制作アプリケーションであり、完全なマルチトラックオーディオとMIDIの録音、編集、処理、ミキシング、マスタリングツールセットを提供します。
Jack Audio Connection Kit別名Jackは、APIを実装するアプリケーション間のオーディオデータとMIDIデータの両方にリアルタイムで低遅延の接続を提供するプロフェッショナルなサウンドサーバーデーモンです。ジャックは、ネットワークを介してオーディオデータを「マスター」マシンに送信するように構成できます。これにより、オーディオが物理デバイスに出力されます。これは、追加のケーブルやハードウェアミキサーを必要とせずに、多くの「スレーブ」コンピューターのオーディオを混合し、オーディオパスをできるだけ長くデジタルに保つのに役立ちます。
Bitwig Studioは、サウンドデザイン、録音、ライブパフォーマンスなどのための線形および非線形のワークフローを備えたデジタルオーディオワークステーションです。 90以上の楽器、エフェクト、およびその他の創造的なツールに加えて。サポートされているWindows、MacOS、Linuxです。
Pipewireは、マルチメディアパイプラインを扱うサーバーおよびユーザースペースAPIです。これは、PulseaudioとJackの両方が現在処理されているユースケースをサポートするために使用できる、オーディオおよびビデオデバイスの上に低遅延のグラフベースの処理エンジンを提供します。 Pipewireは、コンテナ化されたアプリケーションからのオーディオおよびビデオデバイスと対話するための強力なセキュリティモデルを使用して設計されました。グラフ内のノードは、個別のプロセスとして実装でき、ソケットと通信し、FDの合格を使用してマルチメディアコンテンツを交換できます。
Yabridgeは、LinuxでWindows VST2およびVST3プラグインを使用するモダンで透明な方法です。 Yabridgeは、64ビットLinux VSTホストの32ビットと64ビットのWindows VST2およびVST3プラグインを使用して、まるでネイティブVST2およびVST3プラグインであるかのようにシームレスにサポートし、VST2プラグインのプラギン間通信とクイックスタートアップ時間を可能にするプラグイングループのオプションのサポートがあります。
Sonobusは、インターネット上またはローカルネットワーク上のデバイス間の高品質で低い低下のピアツーピアオーディオをストリーミングするための使いやすいアプリケーションです。
Avid Pro Toolsは、ソングライター、ミュージシャン、プロデューサー、エンジニア向けの業界標準オーディオ生産ソフトウェアです。
LMMSは、オープンソースのデジタルオーディオワークステーションアプリケーションプログラムです。 LMMSが適切なコンピューターハードウェアとペアになると、サンプルの配置、サウンドの合成、MIDIキーボードでの再生、トラッカーとシーケンサーの機能を組み合わせることで音楽を作成できます。 Paul GiblockとTobias Junghansによって開発されたこのプログラムは、「Linux Multimedia Studio」の略で、さまざまなオペレーティングシステムで動作できる便利なプラグインをサポートしています。
Ardorは、ミュージシャン、プログラマー、プロのレコーディングエンジニアを含む世界的なチームのオープンソースの協力的な努力です。開発は透明です - 誰でもそれが起こると私たちの仕事を見ることができます。ヴィンテージのハードウェアの良い部分のように、箱を開けて中を見ることができます。
Audacityは、Windows、Mac OS X、GNU/Linux、その他のオペレーティングシステム用の使いやすいマルチトラックオーディオエディターおよびレコーダーです。オープンソースとしてボランティアのグループによって開発され、無料で提供されました。素晴らしいサポートコミュニティ。
Glimpseは、Linux、MacOS、およびWindowsで利用できるGNU画像操作プログラムに基づいたクロスプラットフォームラスターグラフィックエディターです。 YouTubeビデオサムネイルを作成するための素晴らしいツール。
トップに戻ります
Kubernetes（K8S）は、コンテナ化されたアプリケーションの展開、スケーリング、および管理を自動化するためのオープンソースシステムです。
Kubeadmを使用した高度に利用可能性（HA）クラスターの構築。出典：Kubernetes.io、2020
Anthosは、クラウドおよびオンプレミスの環境に一貫した開発と運用の経験を提供する最新のアプリケーション管理プラットフォームです。
Red Hat OpenShiftは、オンプレミス、ハイブリッド、およびマルチラウドの展開の基盤を提供する完全に管理されたKubernetesプラットフォームです。
OKDは、継続的なアプリケーション開発とマルチテナント展開のために最適化されたKubernetesのコミュニティ配信です。 OKDは、Kubernetesに加えて開発者と運用中心のツールを追加して、迅速なアプリケーション開発、簡単な展開とスケーリング、および大規模および大規模なチームの長期的なライフサイクルメンテナンスを可能にします。
ODOは、KubernetesとOpenShiftにアプリケーションを書き、構築し、展開する開発者向けの高速で反復的で簡単なCLIツールです。
Kataオペレーターは、OpenShiftおよびKubernetesクラスターでKataランタイムのライフサイクル管理（インストール/アップグレード/アンインストール）を実行するオペレーターです。
サノスは、無制限のストレージ容量を備えた高度に利用可能なメトリックシステムに構成できるコンポーネントのセットであり、既存のPrometheusの展開の上にシームレスに追加できます。
OpenShift Hiveは、Kubernetes/OpenShiftの上にサービスとして実行されるオペレーターです。 Hiveサービスを使用して、OpenShift 4クラスターの初期構成をプロビジョニングおよび実行できます。
Rookは、分散型ストレージシステムを自己管理、自己スケーリング、自己修復ストレージサービスに変えるツールです。展開、ブートストラップ、構成、プロビジョニング、スケーリング、アップグレード、移行、災害復旧、監視、リソース管理のストレージ管理者のタスクを自動化します。
VMware Tanzuは、複数のチームとプライベート/パブリッククラウドにわたって、Kubernetesインフラストラクチャと最新のアプリケーションを一貫して運用および保護するための集中管理プラットフォームです。
Kubesprayは、KubernetesとAnsibleを組み合わせて、AWS、GCE、Azure、OpenStack、VSphere、Packet（Bare Metal）、Oracle Cloud Infrastructure（実験）、またはBaremetalに展開できるKubernetesクラスターを簡単にインストールするツールです。
Kubeinitは、複数のKubernetes分布の展開と構成のためのAnsible Playbookと役割を提供します。
Rancherは、コンテナを採用するチーム向けの完全なソフトウェアスタックです。複数のKubernetesクラスターを管理するという運用およびセキュリティの課題に対処し、DevOpsチームにコンテナ化されたワークロードを実行するための統合ツールを提供します。
K3Sは、無人でリソースに制約されたリモートの場所またはIoTアプライアンス内の生産ワークロード用に設計された、非常に利用可能で認定されたKubernetes分布です。
HelmはKubernetesパッケージマネージャーツールであり、Kubernetesアプリケーションのインストールと管理を容易にします。
Knivateは、最新のサーバーレスワークロードを構築、展開、および管理するためのKubernetesベースのプラットフォームです。 Knativeは、ネットワーキング、自動強化（ゼロまで）、およびリビジョン追跡の運用上のオーバーヘッドの詳細を処理します。
Kubeflowは、Kubernetesの機械学習（ML）ワークフローの展開をシンプルでポータブルでスケーラブルにすることに専念するツールです。
etcdは、分散システムまたはマシンのクラスターによってアクセスする必要があるデータを保存する信頼できる方法を提供する分散キー値ストアです。 etcdは、サービスディスカバリーのバックエンドとして使用され、kubernetesのクラスター状態と構成を保存します。
OpeneBSは、コンテナ接続ストレージを使用してステートフルアプリケーションを作成するためのKubernetesベースのツールです。
コンテナストレージインターフェイス（CSI）は、Kubernetesなどのコンテナオーケストレーションプラットフォームをプラグインを介して保存されたデータとシームレスに通信できるAPIです。
MicroK8Sは、完全なKubernetesエクスペリエンスを提供するツールです。超信頼性の高い操作のために、圧縮されたオーバーザエアアップデートを備えた完全なコンテナ化された展開で。 Linux、Windows、およびMacOSでサポートされています。
charmed kubernetesは、カノニカルによって開発されたマルチクラウド環境向けに最適化された、よく統合されたターンキーのコンフォーマントクベルネートプラットフォームです。
Grafana Kubernetesアプリは、Kubernetesクラスターのパフォーマンスを監視できる通行料です。 4つのダッシュボード、クラスター、ノード、ポッド/コンテナ、展開が含まれます。これにより、必要なプロメテウス輸出業者の自動展開と、クラスターPrometheusの展開で使用するデフォルトのスクレイプ構成が可能になります。
Kubeedgeは、エッジでホストにネイティブコンテナ化されたアプリケーションオーケストレーション機能を拡張するためのオープンソースシステムです。それはKubernetes上に構築され、ネットワーク、APPの基本的なインフラストラクチャサポートを提供します。クラウドとエッジの間の展開とメタデータの同期。
レンズは、毎日Kubernetesクラスターに対処する必要がある人々にとって最も強力なIDEです。 MacOS、Windows、Linuxオペレーティングシステムをサポートしています。
Kindは、Dockerコンテナ「ノード」を使用してローカルKubernetesクラスターを実行するためのツールです。主にKubernetes自体をテストするために設計されていましたが、ローカル開発またはCIに使用される場合があります。
Flux CDは、Kubernetesクラスターの状態がGitで提供した構成と一致することを自動的に保証するツールです。クラスター内のオペレーターを使用して、Kubernetes内の展開をトリガーします。つまり、個別の連続配信ツールは必要ありません。
Kubernetes認定を取得します
AWSでKubernetesを始めます
Microsoft AzureのKubernetes
Azure Kubernetesサービスへのイントロ
Google Cloudを始めましょう
赤い帽子のkubernetesを始めます
IBMでKubernetesを始めます
KubernetesのYaml基本
Kubernetesの弾性雲
DockerとKubernetes
Azure Kubernetesサービスクラスターにモデルを展開します
Amazon Sagemakerオペレーターを使用してKubernetesの機械学習推論を簡素化する
KubernetesでApache Sparkを実行します
vmware vRealize Automationを介したKubernetes
VMware Tanzu Kubernetesグリッド
VMware TanzuがAWSで動作するすべての方法
VMware Tanzu Education
クラウドネイティブのクベルネテス環境でAnsibleを使用します
Kubernetes（K8S）オブジェクトの管理可能なオブジェクト
VagrantとAnsibleを使用してKubernetesクラスターをセットアップします
KubernetesでMongodbを実行します
Kubernetes Fluentd
新しいGitlab Kubernetesエージェントの理解
Kubernetesの寄稿者
VMwareのKubeacademy
トップに戻ります
Tensorflowは、機械学習用のエンドツーエンドのオープンソースプラットフォームです。ツール、ライブラリ、コミュニティリソースの包括的な柔軟なエコシステムがあり、研究者がMLの最先端をプッシュし、開発者がMLパワーアプリケーションを簡単に構築および展開できるようにします。
Tensormanは、System76.tensormanによって開発されたTensorflow容器の簡単な管理のユーティリティであり、Tensorflowはシステムの残りの部分から含まれる孤立した環境で動作できます。この仮想環境は、ベースシステムとは無関係に動作し、DockerランタイムをサポートするLinux分布の任意のバージョンでTensorFlowの任意のバージョンを使用できます。
Kerasは高レベルのニューラルネットワークAPIで、Pythonで書かれ、Tensorflow、CNTK、またはTheano.itの上で走ることができます。 Tensorflow、Microsoft Cognitive Toolkit、R、Theano、またはPlaidMlの上で走ることができます。
Pytorchは、グラフ、ポイントクラウド、マニホールドなどの不規則な入力データを深く学習するためのライブラリです。主にFacebookのAI Research Labによって開発されました。
Amazon Sagemakerは、すべての開発者とデータサイエンティストに、機械学習（ML）モデルを迅速に構築、トレーニング、展開する機能を提供する完全に管理されたサービスです。 Sagemakerは、機械学習プロセスの各ステップから重い持ち上げを削除して、高品質のモデルの開発を容易にします。
Azure Databricksは、データサイエンスとデータエンジニアリング向けに設計された高速で協力的なApache Sparkベースのビッグデータ分析サービスです。 Azure Databricksは、Apache Spark環境を数分でセットアップし、Autoscaleを設定し、インタラクティブなワークスペースで共有プロジェクトでコラボレーションします。 Azure Databricksは、Python、Scala、R、Java、SQL、およびTensorflow、Pytorch、Scikit-Learnなどのデータサイエンスフレームワークとライブラリをサポートしています。
Microsoft Cognitive Toolkit（CNTK）は、商用グレード分散ディープラーニング向けのオープンソースツールキットです。ニューラルネットワークを、指示されたグラフを介した一連の計算手順として説明しています。 CNTKを使用すると、ユーザーは、フィードフォワードDNN、畳み込みニューラルネットワーク（CNNS）、再発性ニューラルネットワーク（RNNS/LSTM）などの一般的なモデルタイプを簡単に実現および組み合わせて組み合わせることができます。 CNTKは、複数のGPUとサーバーにわたって自動分化と並列化により、確率勾配降下（SGD、エラーバックプロパゲーション）学習を実装します。
Apache Airflowは、コミュニティによって作成されたオープンソースのワークフロー管理プラットフォームであり、ワークフローをプログラム的に著者、スケジュール、監視します。インストール。原則。スケーラブル。 Airflowにはモジュラーアーキテクチャがあり、メッセージキューを使用して、任意の数の労働者を調整します。エアフローは無限にスケーリングする準備ができています。
Open Neural Network Exchange（ONNX）は、AI開発者がプロジェクトの進化に応じて適切なツールを選択できるようにするオープンエコシステムです。 ONNXは、深い学習と従来のMLの両方のAIモデルにオープンソース形式を提供します。拡張可能な計算グラフモデル、および組み込みの演算子と標準データ型の定義を定義します。
Apache MXNetは、効率と柔軟性の両方のために設計された深い学習フレームワークです。これにより、シンボリックと命令的なプログラミングを組み合わせて、効率と生産性を最大化できます。その中心にあるMXNETには、シンボリック操作と命令操作の両方を自動的に平行に並べる動的依存関係スケジューラが含まれています。その上にグラフ最適化レイヤーにより、シンボリック実行が高速になり、メモリ効率が高くなります。 MXNETはポータブルで軽量で、複数のGPUおよび複数のマシンに効果的にスケーリングします。 Python、R、Julia、Scala、Go、JavaScriptなどのサポート。
Autogluonは、機械学習タスクを自動化して、アプリケーションで強力な予測パフォーマンスを簡単に達成できるようにするディープラーニングのためのツールキットです。わずか数行のコードを使用すると、高精度の深い学習モデルを表、画像、テキストデータにトレーニングおよび展開できます。
Anacondaは、ユーザーがモデルを開発し、訓練し、展開できるようにする機械学習と深い学習のための非常に人気のあるデータサイエンスプラットフォームです。
PLAIDMLは、ラップトップ、埋め込みデバイス、または使用可能なコンピューティングハードウェアが十分にサポートされていない、または使用可能なソフトウェアスタックには不快なライセンス制限が含まれている他のデバイスで深い学習を可能にするための高度でポータブルテンソルコンパイラです。
OpenCVは、リアルタイムコンピュータービジョンアプリケーションに焦点を当てた高度に最適化されたライブラリです。 C ++、Python、およびJavaインターフェイスは、Linux、MacOS、Windows、iOS、およびAndroidをサポートしています。
Scikit-Learnは、Scipy、Numpy、およびMatplotlibの上に構築された機械学習用のPythonモジュールであり、多くの一般的な機械学習アルゴリズムの堅牢で簡単な実装を簡単に適用できます。
Wekaは、グラフィカルユーザーインターフェイス、標準端末アプリケーション、またはJava APIを介してアクセスできるオープンソースの機械学習ソフトウェアです。教育、研究、および産業用アプリケーションに広く使用されており、標準の機械学習タスクのための多数の組み込みツールが含まれており、Scikit-Learn、R、Deeplearning4Jなどのよく知られたツールボックスに透明なアクセスを提供します。
Caffeは、表現、速度、モジュール性を念頭に置いて作成された深い学習フレームワークです。 Berkeley AI Research（Bair）/The Berkeley Vision and Learning Center（BVLC）およびコミュニティ貢献者によって開発されました。
Theanoは、numpyとの緊密な統合を含む多次元アレイを含む数学的表現を定義、最適化、評価できるPythonライブラリです。
nGraph is an open source C++ library, compiler and runtime for Deep Learning. The nGraph Compiler aims to accelerate developing AI workloads using any deep learning framework and deploying to a variety of hardware targets.It provides the freedom, performance, and ease-of-use to AI developers.
NVIDIA cuDNN is a GPU-accelerated library of primitives for deep neural networks. cuDNN provides highly tuned implementations for standard routines such as forward and backward convolution, pooling, normalization, and activation layers. cuDNN accelerates widely used deep learning frameworks, including Caffe2, Chainer, Keras, MATLAB, MxNet, PyTorch, and TensorFlow.
Jupyter Notebook is an open-source web application that allows you to create and share documents that contain live code, equations, visualizations and narrative text. Jupyter is used widely in industries that do data cleaning and transformation, numerical simulation, statistical modeling, data visualization, data science, and machine learning.
Apache Spark is a unified analytics engine for large-scale data processing. It provides high-level APIs in Scala, Java, Python, and R, and an optimized engine that supports general computation graphs for data analysis. It also supports a rich set of higher-level tools including Spark SQL for SQL and DataFrames, MLlib for machine learning, GraphX for graph processing, and Structured Streaming for stream processing.
Apache Spark Connector for SQL Server and Azure SQL is a high-performance connector that enables you to use transactional data in big data analytics and persists results for ad-hoc queries or reporting. The connector allows you to use any SQL database, on-premises or in the cloud, as an input data source or output data sink for Spark jobs.
Apache PredictionIO is an open source machine learning framework for developers, data scientists, and end users. It supports event collection, deployment of algorithms, evaluation, querying predictive results via REST APIs. It is based on scalable open source services like Hadoop, HBase (and other DBs), Elasticsearch, Spark and implements what is called a Lambda Architecture.
Cluster Manager for Apache Kafka(CMAK) is a tool for managing Apache Kafka clusters.
BigDL is a distributed deep learning library for Apache Spark. With BigDL, users can write their deep learning applications as standard Spark programs, which can directly run on top of existing Spark or Hadoop clusters.
Koalas is project makes data scientists more productive when interacting with big data, by implementing the pandas DataFrame API on top of Apache Spark.
Apache Spark™ MLflow is an open source platform to manage the ML lifecycle, including experimentation, reproducibility, deployment, and a central model registry. MLflow currently offers four components:
MLflow Tracking : Record and query experiments: code, data, config, and results.
MLflow Projects : Package data science code in a format to reproduce runs on any platform.
MLflow Models : Deploy machine learning models in diverse serving environments.
Model Registry : Store, annotate, discover, and manage models in a central repository.
Eclipse Deeplearning4J (DL4J) is a set of projects intended to support all the needs of a JVM-based(Scala, Kotlin, Clojure, and Groovy) deep learning application. This means starting with the raw data, loading and preprocessing it from wherever and whatever format it is in to building and tuning a wide variety of simple and complex deep learning networks.
Numba is an open source, NumPy-aware optimizing compiler for Python sponsored by Anaconda, Inc. It uses the LLVM compiler project to generate machine code from Python syntax. Numba can compile a large subset of numerically-focused Python, including many NumPy functions. Additionally, Numba has support for automatic parallelization of loops, generation of GPU-accelerated code, and creation of ufuncs and C callbacks.
Chainer is a Python-based deep learning framework aiming at flexibility. It provides automatic differentiation APIs based on the define-by-run approach (dynamic computational graphs) as well as object-oriented high-level APIs to build and train neural networks. It also supports CUDA/cuDNN using CuPy for high performance training and inference.
cuML is a suite of libraries that implement machine learning algorithms and mathematical primitives functions that share compatible APIs with other RAPIDS projects. cuML enables data scientists, researchers, and software engineers to run traditional tabular ML tasks on GPUs without going into the details of CUDA programming. In most cases, cuML's Python API matches the API from scikit-learn.
Machine Learning by Stanford University from Coursera
Machine Learning Courses Online from Coursera
Machine Learning Courses Online from Udemy
Learn Machine Learning with Online Courses and Classes from edX
Back to the Top
ROS is robotics middleware. Although ROS is not an operating system, it provides services designed for a heterogeneous computer cluster such as hardware abstraction, low-level device control, implementation of commonly used functionality, message-passing between processes, and package management.
ROS2 is a set of software libraries and tools that help you build robot applications. From drivers to state-of-the-art algorithms, and with powerful developer tools, ROS has what you need for your next robotics project. And it's all open source.
Robot Framework is a generic open source automation framework. It can be used for test automation and robotic process automation. It has easy syntax, utilizing human-readable keywords. Its capabilities can be extended by libraries implemented with Python or Java.
The Robotics Library (RL) is a self-contained C++ library for robot kinematics, motion planning and control. It covers mathematics, kinematics and dynamics, hardware abstraction, motion planning, collision detection, and visualization.RL runs on many different systems, including Linux, macOS, and Windows. It uses CMake as a build system and can be compiled with Clang, GCC, and Visual Studio.
MoveIt is the most widely used software for manipulation and has been used on over 100 robots. It provides an easy-to-use robotics platform for developing advanced applications, evaluating new designs and building integrated products for industrial, commercial, R&D, and other domains.
AutoGluon is toolkit for Deep learning that automates machine learning tasks enabling you to easily achieve strong predictive performance in your applications. With just a few lines of code, you can train and deploy high-accuracy deep learning models on tabular, image, and text data.
Gazebo accurately and efficiently simulates indoor and outdoor robots. You get a robust physics engine, high-quality graphics, and programmatic and graphical interfaces.
Robotics System Toolbox provides tools and algorithms for designing, simulating, and testing manipulators, mobile robots, and humanoid robots. For manipulators and humanoid robots, the toolbox includes algorithms for collision checking, trajectory generation, forward and inverse kinematics, and dynamics using a rigid body tree representation. For mobile robots, it includes algorithms for mapping, localization, path planning, path following, and motion control. The toolbox provides reference examples of common industrial robot applications. It also includes a library of commercially available industrial robot models that you can import, visualize, and simulate.
Intel Robot DevKit is the tool to generate Robotics Software Development Kit (RDK) designed for autonomous devices, including the ROS2 core and capacibilities packages like perception, planning, control driver etc. It provides flexible build/runtime configurations to meet different autonomous requirement on top of diversity hardware choices, for example use different hareware engine CPU/GPU/VPU to accelerate AI related features.
Arduino is an open-source platform used for building electronics projects. Arduino consists of both a physical programmable circuit board (often referred to as a microcontroller) and a piece of software, or IDE (Integrated Development Environment) that runs on your computer, used to write and upload computer code to the physical board.
ArduPilot enables the creation and use of trusted, autonomous, unmanned vehicle systems for the peaceful benefit of all. ArduPilot provides a comprehensive suite of tools suitable for almost any vehicle and application.
AirSim is a simulator for drones, cars and more, built on Unreal Engine (we now also have an experimental Unity release). It is open-source, cross platform, and supports hardware-in-loop with popular flight controllers such as PX4 for physically and visually realistic simulations.
F´ (F Prime) is a component-driven framework that enables rapid development and deployment of spaceflight and other embedded software applications. Originally developed at the Jet Propulsion Laboratory, F´ has been successfully deployed on several space applications.
The JPL Open Source Rover is an open source, build it yourself, scaled down version of the 6 wheel rover design that JPL uses to explore the surface of Mars. The Open Source Rover is designed almost entirely out of consumer off the shelf (COTS) parts. This project is intended to be a teaching and learning experience for those who want to get involved in mechanical engineering, software, electronics, or robotics.
Light Detection and Ranging(LiDAR) is a remote sensing method that uses light in the form of a pulsed laser at an object, and uses the time and wavelength of the reflected beam of light to estimate the distance and in some applications (Laser Imaging), to create a 3D representation of the object and its surface characteristics. This technology is commonly used in aircraft and self-driving vehicles.
AliceVision is a Photogrammetric Computer Vision Framework which provides a 3D Reconstruction and Camera Tracking algorithms. AliceVision aims to provide strong software basis with state-of-the-art computer vision algorithms that can be tested, analyzed and reused. The project is a result of collaboration between academia and industry to provide cutting-edge algorithms with the robustness and the quality required for production usage.
CARLA is an open-source simulator for autonomous driving research. CARLA has been developed from the ground up to support development, training, and validation of autonomous driving systems. In addition to open-source code and protocols, CARLA provides open digital assets (urban layouts, buildings, vehicles) that were created for this purpose and can be used freely. The simulation platform supports flexible specification of sensor suites and environmental conditions.
ROS bridge is a package to bridge ROS for CARLA Simulator.
ROS-Industrial is an open source project that extends the advanced capabilities of ROS software to manufacturing.
AWS RoboMaker is the most complete cloud solution for robotic developers to simulate, test and securely deploy robotic applications at scale. RoboMaker provides a fully-managed, scalable infrastructure for simulation that customers use for multi-robot simulation and CI/CD integration with regression testing in simulation.
Microsoft Robotics Developer Studio is a free .NET-based programming environment for building robotics applications.
Visual Studio Code Extension for ROS is an extension provides support for Robot Operating System (ROS) development.
Azure Kinect ROS Driver is a node which publishes sensor data from the Azure Kinect Developer Kit to the Robot Operating System (ROS). Developers working with ROS can use this node to connect an Azure Kinect Developer Kit to an existing ROS installation.
Azure IoT Hub for ROS is a ROS package works with the Microsoft Azure IoT Hub service to relay telemetry messages from the Robot to Azure IoT Hub or reflect properties from the Digital Twin to the robot using dynamic reconfigure.
ROS 2 with ONNX Runtime is a program that uses ROS 2 to run on different hardware platforms using their respective AI acceleration libraries for optimized execution of the ONNX model.
Azure Cognitive Services LUIS ROS Node is a ROS node that bridges between ROS and the Azure Language Understanding Service. it can be configured to process audio directly from a microphone, or can subscribe to a ROS audio topic, then processes speech and generates "intent" ROS messages which can be processed by another ROS node to generate ROS commands.
Robotics courses from Coursera
Learn Robotics with Online Courses and Classes from edX
Top Robotics Courses Online from Udemy
Free Online AI & Robotics Courses
REC Foundation Robotics Industry Certification
Carnegie Mellon Robotics Academy
RIA Robotic Integrator Certification Program
AWS RoboMaker – Develop, Test, Deploy, and Manage Intelligent Robotics Apps
Microsoft AI School
Language Understanding (LUIS) for Azure Cognitive Services
Azure VM templates to bootstrap ROS and ROS 2 environments
Google Robotics Research
Back to the Top
Open Source Security Foundation (OpenSSF) is a cross-industry collaboration that brings together leaders to improve the security of open source software by building a broader community, targeted initiatives, and best practices. The OpenSSF brings together open source security initiatives under one foundation to accelerate work through cross-industry support. Along with the Core Infrastructure Initiative and the Open Source Security Coalition, and will include new working groups that address vulnerability disclosures, security tooling and more.
STIGs Benchmarks - Security Technical Implementation Guides
CIS Benchmarks - CIS Center for Internet Security
NIST - Current FIPS
ISO Standards Catalogue
Common Criteria for Information Technology Security Evaluation (CC) is an international standard (ISO / IEC 15408) for computer security. It allows an objective evaluation to validate that a particular product satisfies a defined set of security requirements.
ISO 22301 is the international standard that provides a best-practice framework for implementing an optimised BCMS (business continuity management system).
ISO27001 is the international standard that describes the requirements for an ISMS (information security management system). The framework is designed to help organizations manage their security practices in one place, consistently and cost-effectively.
ISO 27701 specifies the requirements for a PIMS (privacy information management system) based on the requirements of ISO 27001. It is extended by a set of privacy-specific requirements, control objectives and controls. Companies that have implemented ISO 27001 will be able to use ISO 27701 to extend their security efforts to cover privacy management.
EU GDPR (General Data Protection Regulation) is a privacy and data protection law that supersedes existing national data protection laws across the EU, bringing uniformity by introducing just one main data protection law for companies/organizations to comply with.
CCPA (California Consumer Privacy Act) is a data privacy law that took effect on January 1, 2020 in the State of California. It applies to businesses that collect California residents' personal information, and its privacy requirements are similar to those of the EU's GDPR (General Data Protection Regulation).
Payment Card Industry (PCI) Data Security Standards (DSS) is a global information security standard designed to prevent fraud through increased control of credit card data.
SOC 2 is an auditing procedure that ensures your service providers securely manage your data to protect the interests of your comapny/organization and the privacy of their clients.
NIST CSF is a voluntary framework primarily intended for critical infrastructure organizations to manage and mitigate cybersecurity risk based on existing best practice.
AppArmor is an effective and easy-to-use Linux application security system. AppArmor proactively protects the operating system and applications from external or internal threats, even zero-day attacks, by enforcing good behavior and preventing both known and unknown application flaws from being exploited. AppArmor supplements the traditional Unix discretionary access control (DAC) model by providing mandatory access control (MAC). It has been included in the mainline Linux kernel since version 2.6.36 and its development has been supported by Canonical since 2009.
SELinux is a security enhancement to Linux which allows users and administrators more control over access control. Access can be constrained on such variables as which users and applications can access which resources. These resources may take the form of files. Standard Linux access controls, such as file modes (-rwxr-xr-x) are modifiable by the user and the applications which the user runs. Conversely, SELinux access controls are determined by a policy loaded on the system which may not be changed by careless users or misbehaving applications.
Control Groups(Cgroups) is a Linux kernel feature that allows you to allocate resources such as CPU time, system memory, network bandwidth, or any combination of these resources for user-defined groups of tasks (processes) running on a system.
EarlyOOM is a daemon for Linux that enables users to more quickly recover and regain control over their system in low-memory situations with heavy swap usage.
Libgcrypt is a general purpose cryptographic library originally based on code from GnuPG.
Kali Linux is an open source project that is maintained and funded by Offensive Security, a provider of world-class information security training and penetration testing services.
Pi-hole is a DNS sinkhole that protects your devices from unwanted content, without installing any client-side software, intended for use on a private network. It is designed for use on embedded devices with network capability, such as the Raspberry Pi, but it can be used on other machines running Linux and cloud implementations.
Aircrack-ng is a network software suite consisting of a detector, packet sniffer, WEP and WPA/WPA2-PSK cracker and analysis tool for 802.11 wireless LANs. It works with any wireless network interface controller whose driver supports raw monitoring mode and can sniff 802.11a, 802.11b and 802.11g traffic.
Burp Suite is a leading range of cybersecurity tools.
KernelCI is a community-based open source distributed test automation system focused on upstream kernel development. The primary goal of KernelCI is to use an open testing philosophy to ensure the quality, stability and long-term maintenance of the Linux kernel.
Continuous Kernel Integration project helps find bugs in kernel patches before they are commited to an upstram kernel tree. We are team of kernel developers, kernel testers, and automation engineers.
eBPF is a revolutionary technology that can run sandboxed programs in the Linux kernel without changing kernel source code or loading kernel modules. By making the Linux kernel programmable, infrastructure software can leverage existing layers, making them more intelligent and feature-rich without continuing to add additional layers of complexity to the system.
Cilium uses eBPF to accelerate getting data in and out of L7 proxies such as Envoy, enabling efficient visibility into API protocols like HTTP, gRPC, and Kafka.
Hubble is a Network, Service & Security Observability for Kubernetes using eBPF.
Istio is an open platform to connect, manage, and secure microservices. Istio's control plane provides an abstraction layer over the underlying cluster management platform, such as Kubernetes and Mesos.
Certgen is a convenience tool to generate and store certificates for Hubble Relay mTLS.
Scapy is a python-based interactive packet manipulation program & library.
syzkaller is an unsupervised, coverage-guided kernel fuzzer.
SchedViz is a tool for gathering and visualizing kernel scheduling traces on Linux machines.
oss-fuzz aims to make common open source software more secure and stable by combining modern fuzzing techniques with scalable, distributed execution.
OSSEC is a free, open-source host-based intrusion detection system. It performs log analysis, integrity checking, Windows registry monitoring, rootkit detection, time-based alerting, and active response.
Metasploit Project is a computer security project that provides information about security vulnerabilities and aids in penetration testing and IDS signature development.
Wfuzz was created to facilitate the task in web applications assessments and it is based on a simple concept: it replaces any reference to the FUZZ keyword by the value of a given payload.
Nmap is a security scanner used to discover hosts and services on a computer network, thus building a "map" of the network.
Patchwork is a web-based patch tracking system designed to facilitate the contribution and management of contributions to an open-source project.
pfSense is a free and open source firewall and router that also features unified threat management, load balancing, multi WAN, and more.
Snowpatch is a continuous integration tool for projects using a patch-based, mailing-list-centric git workflow. This workflow is used by a number of well-known open source projects such as the Linux kernel.
Snort is an open-source, free and lightweight network intrusion detection system (NIDS) software for Linux and Windows to detect emerging threats.
Wireshark is a free and open-source packet analyzer. It is used for network troubleshooting, analysis, software and communications protocol development, and education.
OpenSCAP is US standard maintained by National Institute of Standards and Technology (NIST). It provides multiple tools to assist administrators and auditors with assessment, measurement, and enforcement of security baselines. OpenSCAP maintains great flexibility and interoperability by reducing the costs of performing security audits. Whether you want to evaluate DISA STIGs, NIST's USGCB, or Red Hat's Security Response Team's content, all are supported by OpenSCAP.
Tink is a multi-language, cross-platform, open source library that provides cryptographic APIs that are secure, easy to use correctly, and harder to misuse.
OWASP is an online community, produces freely-available articles, methodologies, documentation, tools, and technologies in the field of web application security.
Open Vulnerability and Assessment Language is a community effort to standardize how to assess and report upon the machine state of computer systems. OVAL includes a language to encode system details, and community repositories of content. Tools and services that use OVAL provide enterprises with accurate, consistent, and actionable information to improve their security.
ClamAV is an open source antivirus engine for detecting trojans, viruses, malware & other malicious threats.
Microsoft Open Source Software Security
Cloudflare Open Source Security
The Seven Properties of Highly Secure Devices
How Layer 7 of the Internet Works
The 7 Kinds of Security
The Libgcrypt Reference Manual
The Open Web Application Security Project(OWASP) Foundation Top 10
Best Practices for Using Open Source Code from The Linux Foundation
AWS Certified Security - Specialty Certification
Microsoft Certified：Azure Security Engineer Associate
Google Cloud Certified Professional Cloud Security Engineer
Cisco Security Certifications
The Red Hat Certified Specialist in Security: Linux
Linux Professional Institute LPIC-3 Enterprise Security Certification
Cybersecurity Training and Courses from IBM Skills
Cybersecurity Courses and Certifications by Offensive Security
RSA Certification Program
Check Point Certified Security Expert(CCSE) Certification
Check Point Certified Security Administrator(CCSA) Certification
Check Point Certified Security Master (CCSM) Certification
Certified Cloud Security Professional(CCSP) Certification
Certified Information Systems Security Professional (CISSP) Certification
CCNP Routing and Switching
Certified Information Security Manager(CISM)
Wireshark Certified Network Analyst (WCNA)
Juniper Networks Certification Program Enterprise (JNCP)
Security Training Certifications and Courses from Udemy
Security Training Certifications and Courses from Coursera
Security Certifications Training from Pluarlsight
Back to the Top
GitHub provides hosting for software development version control using Git. It offers all of the distributed version control and source code management functionality of Git as well as adding its own features. It provides access control and several collaboration features such as bug tracking, feature requests, task management, and wikis for every project.
GitHub Codespaces is an integrated development environment(IDE) on GitHub. That allows developers to develop entirely in the cloud using Visual Studio and Visual Studio Code.
GitHub Actions will automate, customize, and execute your software development workflows right in your repository with GitHub Actions. You can discover, create, and share actions to perform any job you'd like, including CI/CD, and combine actions in a completely customized workflow.GitHub Actions for Azure you can create workflows that you can set up in your repository to build, test, package, release and deploy to Azure.Learn more about all other integrations with Azure.
GitLab is a web-based DevOps lifecycle tool that provides a Git-repository manager providing wiki, issue-tracking and CI/CD pipeline features, using an open-source license, developed by GitLab Inc.
Jenkins is a free and open source automation server. Jenkins helps to automate the non-human part of the software development process, with continuous integration and facilitating technical aspects of continuous delivery.
Bitbucket is a web-based version control repository hosting service owned by Atlassian, for source code and development projects that use either Mercurial or Git revision control systems. Bitbucket offers both commercial plans and free accounts. It offers free accounts with an unlimited number of private repositories. Bitbucket integrates with other Atlassian software like Jira, HipChat, Confluence and Bamboo.
Bamboo is a continuous integration (CI) server that can be used to automate the release management for a software application, creating a continuous delivery pipeline.
Codecov is the leading, dedicated code coverage solution. It provides highly integrated tools to group, merge, archive and compare coverage reports. Whether your team is comparing changes in a pull request or reviewing a single commit, Codecov will improve the code review workflow and quality.
Drone is a Continuous Delivery system built on container technology. Drone uses a simple YAML configuration file, a superset of docker-compose, to define and execute Pipelines inside Docker containers.
Travis CI is a hosted continuous integration service used to build and test software projects hosted at GitHub.
Circle CI is a continuous integration and continuous delivery platform that helps software teams work smarter, faster.
Zuul-CI is a program that drives continuous integration, delivery, and deployment systems with a focus on project gating and interrelated projects. Using the same Ansible playbooks to deploy your system and run your tests.
Artifactory is a Universal Artifact Repository Manager developed by JFrog. It supports all major packages, enterprise ready security, clustered, HA, Docker registry, multi-site replication and scalable.
Azure DevOps is a set of services for teams to share code, track work, and ship software; CLIs Build, deploy, diagnose, and manage multi-platform, scalable apps and services; Azure Pipelines Continuously build, test, and deploy to any platform and cloud; Azure Lab Services Set up labs for classrooms, trials, development and testing, and other scenarios.
Team City is a build management and continuous integration server from JetBrains.
Shippable simplifies DevOps and makes it systematic with an Assembly Line platform that is heterogeneous, flexible, and provides complete visibility across your DevOps workflows.
Spinnaker is an open source, multi-cloud continuous delivery platform for releasing software changes with high velocity and confidence.
AWS CodeBuild is a fully managed continuous integration service that compiles source code, runs tests, and produces software packages that are ready to deploy. With CodeBuild, you don't need to provision, manage, and scale your own build servers.
Selenium is a free (open source) automated testing suite for web applications across different browsers and platforms.
Cucumber is a tool based on Behavior Driven Development (BDD) framework which is used to write acceptance tests for the web application. It allows automation of functional validation in easily readable and understandable format (like plain English) to Business Analysts, Developers, and Testers.
JUnit is a unit testing framework for the Java programming language.
Mocha is a JavaScript test framework for Node.js programs, featuring browser support, asynchronous testing, test coverage reports, and use of any assertion library.
Karma is a simple tool that allows you to execute JavaScript code in multiple real browsers.
Jasmine is an open source testing framework for JavaScript. It aims to run on any JavaScript-enabled platform, to not intrude on the application nor the IDE, and to have easy-to-read syntax.
Maven is a build automation tool used primarily for Java projects. Maven can also be used to build and manage projects written in C#, Ruby, Scala, and other languages. The Maven project is hosted by the Apache Software Foundation.
Gradle is an open-source build-automation system that builds upon the concepts of Apache Ant and Apache Maven and introduces a Groovy-based domain-specific language instead of the XML form used by Apache Maven for declaring the project configuration.
Chef is an effortless Infrastructure Suite offers visibility into security and compliance status across all infrastructure and makes it easy to detect and correct issues long before they reach production.
Puppet is an open source tool that makes continuous integration and delivery of your software on traditional or containerized infrastructure easy by pulling together all your existing tools and giving you flexibility to deploy your way.
Ansible is an open-source software provisioning, configuration management, and application-deployment tool. It runs on many Unix-like systems, and can configure both Unix-like systems as well as Microsoft Windows.
KubeInit provides Ansible playbooks and roles for the deployment and configuration of multiple Kubernetes distributions.
Salt is Python-based, open-source software for event-driven IT automation, remote task execution, and configuration management. Supporting the "Infrastructure as Code" approach to data center system and network deployment and management, configuration automation, SecOps orchestration, vulnerability remediation, and hybrid cloud control.
Terraform is an open-source infrastructure as code software tool created by HashiCorp.It enables users to define and provision a datacenter infrastructure using a high-level configuration language known as Hashicorp Configuration Language (HCL), or optionally JSON.
Consul is a service networking solution to connect and secure services across any runtime platform and public or private cloud.
Packer is lightweight, runs on every major operating system, and is highly performant, creating machine images for multiple platforms in parallel. Packer does not replace configuration management like Chef or Puppet. In fact, when building images, Packer is able to use tools like Chef or Puppet to install software onto the image.
Nomad is a highly available, distributed, data-center aware cluster and application scheduler designed to support the modern datacenter with support for long-running services, batch jobs, and much more.
Vagrant is a tool for building and managing virtual machine environments in a single workflow. With an easy-to-use workflow and focus on automation, Vagrant lowers development environment setup time and increases production parity.
Vault is a tool for securely accessing secrets. A secret is anything that you want to tightly control access to, such as API keys, passwords, certificates, and more. Vault provides a unified interface to any secret, while providing tight access control and recording a detailed audit log.
CFEngine is an open-source configuration management system, written by Mark Burgess.Its primary function is to provide automated configuration and maintenance of large-scale computer systems, including the unified management of servers, desktops, consumer and industrial devices, embedded networked devices, mobile smartphones, and tablet computers.
Octpus Deploy is the deployment automation server for your entire team, designed to make it easy to orchestrate releases and deploy applications, whether on-premises or in the cloud.
AWS CodeDeploy is a fully managed deployment service that automates software deployments to a variety of compute services such as Amazon EC2, AWS Fargate, AWS Lambda, and your on-premises servers. AWS CodeDeploy makes it easier for you to rapidly release new features, helps you avoid downtime during application deployment, and handles the complexity of updating your applications.
Kubernetes is an open-source container-orchestration system for automating application deployment, scaling, and management. It was originally designed by Google, and is now maintained by the Cloud Native Computing Foundation.
Docker is a set of platform as a service products that use OS-level virtualization to deliver software in packages called containers. Containers are isolated from one another and bundle their own software, libraries and configuration files; they can communicate with each other through well-defined channels. All containers are run by a single operating-system kernel and are thus more lightweight than virtual machines.
PowerShell/PowerShell Core is a cross-platform (Windows, Linux, and macOS) automation and configuration tool/framework that works well with your existing tools and is optimized for dealing with structured data (eg JSON, CSV, XML, etc.), REST APIs, and object models. It includes a command-line shell, an associated scripting language and a framework for processing cmdlets.
Hyper-V creates virtual machines on Windows 10. Hyper-V can be enabled in many ways including using the Windows 10 control panel, PowerShell or using the Deployment Imaging Servicing and Management tool (DISM).
Cloud Hypervisor is an open source Virtual Machine Monitor (VMM) that runs on top of KVM. The project focuses on exclusively running modern, cloud workloads, on top of a limited set of hardware architectures and platforms. Cloud workloads refers to those that are usually run by customers inside a cloud provider. Cloud Hypervisor is implemented in Rust and is based on the rust-vmm crates.
VMware vSphere Hypervisor is a bare-metal hypervisor that virtualizes servers; allowing you to consolidate your applications while saving time and money managing your IT infrastructure.
VMware vSphere is the industry-leading compute virtualization platform, and your first step to application modernization. It has been rearchitected with native Kubernetes to allow customers to modernize the 70 million+ workloads now running on vSphere.
VMware Tanzu is a centralized management platform for consistently operating and securing your Kubernetes infrastructure and modern applications across multiple teams and private/public clouds.
Rancher is a complete software stack for teams adopting containers. It addresses the operational and security challenges of managing multiple Kubernetes clusters, while providing DevOps teams with integrated tools for running containerized workloads.
K3s is a highly available, certified Kubernetes distribution designed for production workloads in unattended, resource-constrained, remote locations or inside IoT appliances.
Rook is an open source cloud-native storage orchestrator for Kubernetes that turns distributed storage systems into self-managing, self-scaling, self-healing storage services. It automates the tasks of a storage administrator: deployment, bootstrapping, configuration, provisioning, scaling, upgrading, migration, disaster recovery, monitoring, and resource management.
Google Kubernetes Engine (GKE) is a managed, production-ready environment for deploying containerized applications.
Anthos is a modern application management platform that provides a consistent development and operations experience for cloud and on-premises environments.
AWS ECS is a highly scalable, high-performance container orchestration service that supports Docker containers and allows you to easily run and scale containerized applications on AWS. Amazon ECS eliminates the need for you to install and operate your own container orchestration software, manage and scale a cluster of virtual machines, or schedule containers on those virtual machines.
Apache Mesos is a cluster manager that provides efficient resource isolation and sharing across distributed applications, or frameworks. It can run Hadoop, Jenkins, Spark, Aurora, and other frameworks on a dynamically shared pool of nodes.
Apache Spark is a unified analytics engine for big data processing, with built-in modules for streaming, SQL, machine learning and graph processing.
Apache Hadoop is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. Rather than rely on hardware to deliver high-availability, the library itself is designed to detect and handle failures at the application layer, so delivering a highly-available service on top of a cluster of computers, each of which may be prone to failures.
Microsoft Azure is a cloud computing service created by Microsoft for building, testing, deploying, and managing applications and services through Microsoft-managed data centers.
Azure Functions is a solution for easily running small pieces of code, or "functions," in the cloud. You can write just the code you need for the problem at hand, without worrying about a whole application or the infrastructure to run it.
Rkt is a pod-native container engine for Linux. It is composable, secure, and built on standards.
AWS Lambda is an event-driven, serverless computing platform provided by Amazon as a part of the Amazon Web Services. It is a computing service that runs code in response to events and automatically manages the computing resources required by that code.
Helm is the Kubernetes Package Manager.
Kubespray is a tool that combines Kubernetes and Ansible to easily install Kubernetes clusters that can be deployed on AWS, GCE, Azure, OpenStack, vSphere, Packet (bare metal), Oracle Cloud Infrastructure (Experimental), or Baremetal
Red Hat OpenShift is focused on security at every level of the container stack and throughout the application lifecycle. It includes long-term, enterprise support from one of the leading Kubernetes contributors and open source software companies.
OpenShift Hive is an operator which runs as a service on top of Kubernetes/OpenShift. The Hive service can be used to provision and perform initial configuration of OpenShift 4 clusters.
OKD is a community distribution of Kubernetes optimized for continuous application development and multi-tenant deployment. OKD adds developer and operations-centric tools on top of Kubernetes to enable rapid application development, easy deployment and scaling, and long-term lifecycle maintenance for small and large teams.
Odo is a fast, iterative, and straightforward CLI tool for developers who write, build, and deploy applications on Kubernetes and OpenShift.
Kata Operator is an operator to perform lifecycle management (install/upgrade/uninstall) of Kata Runtime on Openshift as well as Kubernetes cluster.
Knative is a Kubernetes-based platform to build, deploy, and manage modern serverless workloads. Knative takes care of the operational overhead details of networking, autoscaling (even to zero), and revision tracking.
Etcd is a distributed key-value store that provides a reliable way to store data that needs to be accessed by a distributed system or cluster of machines. Etcd is used as the backend for service discovery and stores cluster state and configuration for Kubernetes.
OpenStack is a free and open-source software platform for cloud computing, mostly deployed as infrastructure-as-a-service that controls large pools of compute, storage, and networking resources throughout a datacenter, managed through a dashboard or via the OpenStack API. OpenStack works with popular enterprise and open source technologies making it ideal for heterogeneous infrastructure.
Cloud Foundry is an open source, multi cloud application platform as a service that makes it faster and easier to build, test, deploy and scale applications, providing a choice of clouds, developer frameworks, and application services. It is an open source project and is available through a variety of private cloud distributions and public cloud instances.
Splunk software is used for searching, monitoring, and analyzing machine-generated big data, via a Web-style interface.
Prometheus is a free software application used for event monitoring and alerting. It records real-time metrics in a time series database (allowing for high dimensionality) built using a HTTP pull model, with flexible queries and real-time alerting.
Loki is a horizontally-scalable, highly-available, multi-tenant log aggregation system inspired by Prometheus. It is designed to be very cost effective and easy to operate. It does not index the contents of the logs, but rather a set of labels for each log stream.
Thanos is a set of components that can be composed into a highly available metric system with unlimited storage capacity, which can be added seamlessly on top of existing Prometheus deployments.
Container Storage Interface (CSI) is an API that lets container orchestration platforms like Kubernetes seamlessly communicate with stored data via a plug-in.
OpenEBS is a Kubernetes-based tool to create stateful applications using Container Attached Storage.
ElasticSearch is a search engine based on the Lucene library. It provides a distributed, multitenant-capable full-text search engine with an HTTP web interface and schema-free JSON documents. Elasticsearch is developed in Java.
Logstash is a tool for managing events and logs. When used generically, the term encompasses a larger system of log collection, processing, storage and searching activities.
Kibana is an open source data visualization plugin for Elasticsearch. It provides visualization capabilities on top of the content indexed on an Elasticsearch cluster. Users can create bar, line and scatter plots, or pie charts and maps on top of large volumes of data.
New Relic is a SaaS-based monitoring tool that fully supports the way DevOps teams work in the modern enterprise by streamlining your workflows with today's collaboration software and orchestration tools like Puppet, Chef, and Ansible.
Nagios is a free and open source computer-software application that monitors systems, networks and infrastructure. Nagios offers monitoring and alerting services for servers, switches, applications and services. It alerts users when things go wrong and alerts them a second time when the problem has been resolved.
SonarQube is an open-source platform developed by SonarSource for continuous inspection of code quality to perform automatic reviews with static analysis of code to detect bugs, code smells, and security vulnerabilities on 20+ programming languages.
Genie is a federated job orchestration engine developed by Netflix. Genie provides REST APIs to run a variety of big data jobs like Hadoop, Pig, Hive, Spark, Presto, Sqoop and more. It also provides APIs for managing the metadata of many distributed processing clusters and the commands and applications which run on them.
Inviso is a lightweight tool that provides the ability to search for Hadoop jobs, visualize the performance, and view cluster utilization.
Fenzo is a scheduler Java library for Apache Mesos frameworks that supports plugins for scheduling optimizations and facilitates cluster autoscaling.
Dynomite is a thin, distributed dynamo layer for different storage engines and protocols, which includes Redis and Memcached. Dynomite supports multi-datacenter replication and is designed for High Availability(HA).
Dyno is a tool that is used to scale a Java client application utilizing Dynomite.
Raigad is a process/tool that runs alongside Elasticsearch to automate backup/recovery, Deployments and Centralized Configuration management.
Priam is a process/tool that runs alongside Apache Cassandra to automate backup/recovery, Deployments and Centralized Configuration management.
Chaos Monkey is a resiliency tool used to randomly terminates virtual machine instances and containers that run inside of your production environment. Chaos Monkey should work with any backend that Spinnaker supports (AWS, Google Compute Engine, Microsoft Azure, Kubernetes, and Cloud Foundry).
Falcor is a JavaScript library for efficient data fetching. Falcor lets you represent all your remote data sources as a single domain model via a virtual JSON graph, whether in memory on the client or over the network on the server.
Restify is a framework, utilizing connect style middleware for building REST APIs.
Traefik is an open source Edge Router that makes publishing your services a fun and easy experience. It receives requests on behalf of your system and finds out which components are responsible for handling them. What sets Traefik apart, besides its many features, is that it automatically discovers the right configuration for your services.
Jira is a proprietary issue tracking product developed by Atlassian that allows bug tracking and agile project management.
Pivotal Tracker is the agile project management tool of choice for developers around the world for real-time collaboration around a shared, prioritized backlog.
Trello is a web-based Kanban-style list-making application that gives you perspective over all your projects, at work and at home.
Microsoft Teams is the hub for team collaboration in Office 365 that integrates the people, content, and tools your team needs to be more engaged and effective.
Slack is a cloud-based proprietary instant messaging platform developed by Slack Technologies.
OpsGenie is a cloud-based service for dev & ops teams, providing reliable alerts, on-call schedule management and escalations. OpsGenie integrates with monitoring tools & services, ensures the right people are notified.
Pagerduty automates processes built on best practices, allowing you to focus on higher value parts of incident response. Granular and scalable permissions enable teams to administer and operate independently while controlling visibility.
Veracode is a leading provider of enterprise-class application security, seamlessly integrating agile security solutions for organizations around the globe. In addition to application security services and secure devops services, Veracode provides a full security assessment to ensure your website and applications are secure, and ensures full enterprise data protection.
DevOps Engineering on AWS from AWS Training
AWS Certified DevOps Engineer - Professional from A Cloud Guru
Microsoft Certified: DevOps Engineer Expert Cert.
Introduction to Azure DevOps from A Cloud Guru
Architecting with Google Compute Engine
Architecting with Google Kubernetes Engine in Google Cloud
VMware Training and Certification Program
Cloudera Certification Program
Salesforce Certification Program
Salesforce Superbadges
Red Hat Training and Certification Program
Linux Foundation Training and Certification Program
Linux Professional Institute(LPI) Training and Certification
Learn DevOps with Online Courses and Lessons from edX
Top DevOps Courses Online from Udemy
Devops Courses from Coursera
Back to the Top
Flutter is Google's UI toolkit for crafting beautiful, natively compiled applications for mobile(Andorid and iOS), web, and desktop(Windows, MacOS, Linux, and Google Fuchsia) from a single codebase. Flutter works with existing code, is used by developers and organizations around the world, and is free and open source.
Flutter Gems is a curated package guide for Flutter which functionally categorizes some of the most useful and popular flutter packages available on pub.dev Flutter Gems A Flutter package landscape guide comprising 1500+ neatly categorized useful and popular packages.
Dart is an open-source, scalable programming language, with robust libraries and runtimes, for building web, server, and mobile apps using the Flutter framework.
Flutter documentation
Style Guide for Flutter
Creating your first Flutter app
Build and release an Android app using Flutter
Flutter Tools & techniques
Dart and Flutter: The Complete Developer's Guide on Udemy
Creating an Interactive Story with Flutter on Coursera
Flutter for Beginners course on Pluralsight
Flutter Online Training Courses on LinkedIn Learning
The Complete Flutter App Development Bootcamp with Dart by App Brewery
Adding Firebase to your Flutter app
Using Firebase and Firestore with Flutter
Fuchsia Project
Getting Started with Fuchsia
Fuchsia Reference
Contributing to Fuchsia
Firebase is a Backend-as-a-Service (BaaS) app development platform that provides hosted backend services such as a realtime database, cloud storage, authentication, crash reporting, machine learning, remote configuration, and hosting for your static files.
FlutterFire is a set of Flutter plugins that enable Flutter apps to use Firebase services. You can follow an example that shows how to use these plugins in the Firebase for Flutter codelab.
FlutterBoost is a Flutter plugin which enables hybrid integration of Flutter for your existing native apps with minimum efforts.
Go-flutter is a package that brings Flutter to the desktop. project implements the Flutter's Embedding API using a single code base that runs on Windows, macOS, and Linux. For rendering, GLFW fits the job because it provides the right abstractions over the OpenGL's Buffer/Mouse/Keyboard for each platform.
Appwrite is a secure end-to-end backend server for Web, Mobile, and Flutter developers that is packaged as a set of Docker containers for easy deployment.
Fluro is a Flutter routing library that adds flexible routing options like wildcards, named parameters and clear route definitions.
Back to the Top
AWS Certified Security - Specialty Certification
Microsoft Certified：Azure Security Engineer Associate
Google Cloud Certified Professional Cloud Security Engineer
Cisco Security Certifications
The Red Hat Certified Specialist in Security: Linux
Linux Professional Institute LPIC-3 Enterprise Security Certification
Cybersecurity Training and Courses from IBM Skills
Cybersecurity Courses and Certifications by Offensive Security
Citrix Certified Associate – Networking(CCA-N)
Citrix Certified Professional – Virtualization(CCP-V)
CCNP Routing and Switching
Certified Information Security Manager(CISM)
Wireshark Certified Network Analyst (WCNA)
Juniper Networks Certification Program Enterprise (JNCP)
Networking courses and specializations from Coursera
Network & Security Courses from Udemy
Network & Security Courses from edX
• Connection: In networking, a connection refers to pieces of related information that are transferred through a network. This generally infers that a connection is built before the data transfer (by following the procedures laid out in a protocol) and then is deconstructed at the at the end of the data transfer.
• Packet: A packet is, generally speaking, the most basic unit that is transferred over a network. When communicating over a network, packets are the envelopes that carry your data (in pieces) from one end point to the other.
Packets have a header portion that contains information about the packet including the source and destination, timestamps, network hops. The main portion of a packet contains the actual data being transferred. It is sometimes called the body or the payload.
• Network Interface: A network interface can refer to any kind of software interface to networking hardware. For instance, if you have two network cards in your computer, you can control and configure each network interface associated with them individually.
A network interface may be associated with a physical device, or it may be a representation of a virtual interface. The "loop-back" device, which is a virtual interface to the local machine, is an example of this.
• LAN: LAN stands for "local area network". It refers to a network or a portion of a network that is not publicly accessible to the greater internet. A home or office network is an example of a LAN.
• WAN: WAN stands for "wide area network". It means a network that is much more extensive than a LAN. While WAN is the relevant term to use to describe large, dispersed networks in general, it is usually meant to mean the internet, as a whole.
If an interface is connected to the WAN, it is generally assumed that it is reachable through the internet.
• Protocol: A protocol is a set of rules and standards that basically define a language that devices can use to communicate. There are a great number of protocols in use extensively in networking, and they are often implemented in different layers.
Some low level protocols are TCP, UDP, IP, and ICMP. Some familiar examples of application layer protocols, built on these lower protocols, are HTTP (for accessing web content), SSH, TLS/SSL, and FTP.
• Port: A port is an address on a single machine that can be tied to a specific piece of software. It is not a physical interface or location, but it allows your server to be able to communicate using more than one application.
• Firewall: A firewall is a program that decides whether traffic coming into a server or going out should be allowed. A firewall usually works by creating rules for which type of traffic is acceptable on which ports. Generally, firewalls block ports that are not used by a specific application on a server.
• NAT: Network address translation is a way to translate requests that are incoming into a routing server to the relevant devices or servers that it knows about in the LAN. This is usually implemented in physical LANs as a way to route requests through one IP address to the necessary backend servers.
• VPN: Virtual private network is a means of connecting separate LANs through the internet, while maintaining privacy. This is used as a means of connecting remote systems as if they were on a local network, often for security reasons.
While networking is often discussed in terms of topology in a horizontal way, between hosts, its implementation is layered in a vertical fashion throughout a computer or network. This means is that there are multiple technologies and protocols that are built on top of each other in order for communication to function more easily. Each successive, higher layer abstracts the raw data a little bit more, and makes it simpler to use for applications and users. It also allows you to leverage lower layers in new ways without having to invest the time and energy to develop the protocols and applications that handle those types of traffic.
As data is sent out of one machine, it begins at the top of the stack and filters downwards. At the lowest level, actual transmission to another machine takes place. At this point, the data travels back up through the layers of the other computer. Each layer has the ability to add its own "wrapper" around the data that it receives from the adjacent layer, which will help the layers that come after decide what to do with the data when it is passed off.
One method of talking about the different layers of network communication is the OSI model. OSI stands for Open Systems Interconnect.This model defines seven separate layers. The layers in this model are:
• Application: The application layer is the layer that the users and user-applications most often interact with. Network communication is discussed in terms of availability of resources, partners to communicate with, and data synchronization.
• Presentation: The presentation layer is responsible for mapping resources and creating context. It is used to translate lower level networking data into data that applications expect to see.
• Session: The session layer is a connection handler. It creates, maintains, and destroys connections between nodes in a persistent way.
• Transport: The transport layer is responsible for handing the layers above it a reliable connection. In this context, reliable refers to the ability to verify that a piece of data was received intact at the other end of the connection. This layer can resend information that has been dropped or corrupted and can acknowledge the receipt of data to remote computers.
• Network: The network layer is used to route data between different nodes on the network. It uses addresses to be able to tell which computer to send information to. This layer can also break apart larger messages into smaller chunks to be reassembled on the opposite end.
• Data Link: This layer is implemented as a method of establishing and maintaining reliable links between different nodes or devices on a network using existing physical connections.
• Physical: The physical layer is responsible for handling the actual physical devices that are used to make a connection. This layer involves the bare software that manages physical connections as well as the hardware itself (like Ethernet).
The TCP/IP model, more commonly known as the Internet protocol suite, is another layering model that is simpler and has been widely adopted.It defines the four separate layers, some of which overlap with the OSI model:
• Application: In this model, the application layer is responsible for creating and transmitting user data between applications. The applications can be on remote systems, and should appear to operate as if locally to the end user.
The communication takes place between peers network.
• Transport: The transport layer is responsible for communication between processes. This level of networking utilizes ports to address different services. It can build up unreliable or reliable connections depending on the type of protocol used.
• Internet: The internet layer is used to transport data from node to node in a network. This layer is aware of the endpoints of the connections, but does not worry about the actual connection needed to get from one place to another. IP addresses are defined in this layer as a way of reaching remote systems in an addressable manner.
• Link: The link layer implements the actual topology of the local network that allows the internet layer to present an addressable interface. It establishes connections between neighboring nodes to send data.
Interfaces are networking communication points for your computer. Each interface is associated with a physical or virtual networking device. Typically, your server will have one configurable network interface for each Ethernet or wireless internet card you have. In addition, it will define a virtual network interface called the "loopback" or localhost interface. This is used as an interface to connect applications and processes on a single computer to other applications and processes. You can see this referenced as the "lo" interface in many tools.
Networking works by piggybacks on a number of different protocols on top of each other. In this way, one piece of data can be transmitted using multiple protocols encapsulated within one another.
Media access control is a communications protocol that is used to distinguish specific devices. Each device is supposed to get a unique MAC address during the manufacturing process that differentiates it from every other device on the internet. Addressing hardware by the MAC address allows you to reference a device by a unique value even when the software on top may change the name for that specific device during operation. Media access control is one of the only protocols from the link layer that you are likely to interact with on a regular basis.
The IP protocol is one of the fundamental protocols that allow the internet to work. IP addresses are unique on each network and they allow machines to address each other across a network. It is implemented on the internet layer in the IP/TCP model. Networks can be linked together, but traffic must be routed when crossing network boundaries. This protocol assumes an unreliable network and multiple paths to the same destination that it can dynamically change between. There are a number of different implementations of the protocol. The most common implementation today is IPv4, although IPv6 is growing in popularity as an alternative due to the scarcity of IPv4 addresses available and improvements in the protocols capabilities.
ICMP: internet control message protocol is used to send messages between devices to indicate the availability or error conditions. These packets are used in a variety of network diagnostic tools, such as ping and traceroute. Usually ICMP packets are transmitted when a packet of a different kind meets some kind of a problem. Basically, they are used as a feedback mechanism for network communications.
TCP: Transmission control protocol is implemented in the transport layer of the IP/TCP model and is used to establish reliable connections. TCP is one of the protocols that encapsulates data into packets. It then transfers these to the remote end of the connection using the methods available on the lower layers. On the other end, it can check for errors, request certain pieces to be resent, and reassemble the information into one logical piece to send to the application layer. The protocol builds up a connection prior to data transfer using a system called a three-way handshake. This is a way for the two ends of the communication to acknowledge the request and agree upon a method of ensuring data reliability. After the data has been sent, the connection is torn down using a similar four-way handshake. TCP is the protocol of choice for many of the most popular uses for the internet, including WWW, FTP, SSH, and email. It is safe to say that the internet we know today would not be here without TCP.
UDP: User datagram protocol is a popular companion protocol to TCP and is also implemented in the transport layer. The fundamental difference between UDP and TCP is that UDP offers unreliable data transfer. It does not verify that data has been received on the other end of the connection. This might sound like a bad thing, and for many purposes, it is. However, it is also extremely important for some functions. It's not required to wait for confirmation that the data was received and forced to resend data, UDP is much faster than TCP. It does not establish a connection with the remote host, it simply fires off the data to that host and doesn't care if it is accepted or not. Since UDP is a simple transaction, it is useful for simple communications like querying for network resources. It also doesn't maintain a state, which makes it great for transmitting data from one machine to many real-time clients. This makes it ideal for VOIP, games, and other applications that cannot afford delays.
HTTP: Hypertext transfer protocol is a protocol defined in the application layer that forms the basis for communication on the web. HTTP defines a number of functions that tell the remote system what you are requesting. For instance, GET, POST, and DELETE all interact with the requested data in a different way.
JSON Web Token (JWT) is a compact URL-safe means of representing claims to be transferred between two parties. The claims in a JWT are encoded as a JSON object that is digitally signed using JSON Web Signature (JWS).
OAuth 2.0 is an open source authorization framework that enables applications to obtain limited access to user accounts on an HTTP service, such as Amazon, Google, Facebook, Microsoft, Twitter GitHub, and DigitalOcean. It works by delegating user authentication to the service that hosts the user account, and authorizing third-party applications to access the user account.
FTP: File transfer protocol is in the application layer and provides a way of transferring complete files from one host to another. It is inherently insecure, so it is not recommended for any externally facing network unless it is implemented as a public, download-only resource.
DNS: Domain name system is an application layer protocol used to provide a human-friendly naming mechanism for internet resources. It is what ties a domain name to an IP address and allows you to access sites by name in your browser.
SSH: Secure shell is an encrypted protocol implemented in the application layer that can be used to communicate with a remote server in a secure way. Many additional technologies are built around this protocol because of its end-to-end encryption and ubiquity. There are many other protocols that we haven't covered that are equally important. However, this should give you a good overview of some of the fundamental technologies that make the internet and networking possible.
KVM (for Kernel-based Virtual Machine) is a full virtualization solution for Linux on x86 hardware containing virtualization extensions (Intel VT or AMD-V). It consists of a loadable kernel module, kvm.ko, that provides the core virtualization infrastructure and a processor specific module, kvm-intel.ko or kvm-amd.ko.
QEMU is a fast processor emulator using a portable dynamic translator. QEMU emulates a full system, including a processor and various peripherals. It can be used to launch a different Operating System without rebooting the PC or to debug system code.
Hyper-V enables running virtualized computer systems on top of a physical host. These virtualized systems can be used and managed just as if they were physical computer systems, however they exist in virtualized and isolated environment. Special software called a hypervisor manages access between the virtual systems and the physical hardware resources. Virtualization enables quick deployment of computer systems, a way to quickly restore systems to a previously known good state, and the ability to migrate systems between physical hosts.
VirtManager is a graphical tool for managing virtual machines via libvirt. Most usage is with QEMU/KVM virtual machines, but Xen and libvirt LXC containers are well supported. Common operations for any libvirt driver should work.
oVirt is an open-source distributed virtualization solution, designed to manage your entire enterprise infrastructure. oVirt uses the trusted KVM hypervisor and is built upon several other community projects, including libvirt, Gluster, PatternFly, and Ansible.Founded by Red Hat as a community project on which Red Hat Enterprise Virtualization is based allowing for centralized management of virtual machines, compute, storage and networking resources, from an easy-to-use web-based front-end with platform independent access.
Xen is focused on advancing virtualization in a number of different commercial and open source applications, including server virtualization, Infrastructure as a Services (IaaS), desktop virtualization, security applications, embedded and hardware appliances, and automotive/aviation.
Ganeti is a virtual machine cluster management tool built on top of existing virtualization technologies such as Xen or KVM and other open source software. Once installed, the tool assumes management of the virtual instances (Xen DomU).
Packer is an open source tool for creating identical machine images for multiple platforms from a single source configuration. Packer is lightweight, runs on every major operating system, and is highly performant, creating machine images for multiple platforms in parallel. Packer does not replace configuration management like Chef or Puppet. In fact, when building images, Packer is able to use tools like Chef or Puppet to install software onto the image.
Vagrant is a tool for building and managing virtual machine environments in a single workflow. With an easy-to-use workflow and focus on automation, Vagrant lowers development environment setup time, increases production parity, and makes the "works on my machine" excuse a relic of the past. It provides easy to configure, reproducible, and portable work environments built on top of industry-standard technology and controlled by a single consistent workflow to help maximize the productivity and flexibility of you and your team.
VMware Workstation is a hosted hypervisor that runs on x64 versions of Windows and Linux operating systems; it enables users to set up virtual machines on a single physical machine, and use them simultaneously along with the actual machine.
VirtualBox is a powerful x86 and AMD64/Intel64 virtualization product for enterprise as well as home use. Not only is VirtualBox an extremely feature rich, high performance product for enterprise customers.
Back to the Top
SQL is a standard language for storing, manipulating and retrieving data in relational databases.
SQL Tutorial by W3Schools
Learn SQL Skills Online from Coursera
SQL Courses Online from Udemy
SQL Online Training Courses from LinkedIn Learning
Learn SQL For Free from Codecademy
GitLab's SQL Style Guide
OracleDB SQL Style Guide Basics
Tableau CRM: BI Software and Tools
Databases on AWS
Best Practices and Recommendations for SQL Server Clustering in AWS EC2.
Connecting from Google Kubernetes Engine to a Cloud SQL instance.
Educational Microsoft Azure SQL resources
MySQL Certifications
SQL vs. NoSQL Databases: What's the Difference?
What is NoSQL?
Azure Data Studio is an open source data management tool that enables working with SQL Server, Azure SQL DB and SQL DW from Windows, macOS and Linux.
Azure SQL Database is the intelligent, scalable, relational database service built for the cloud. It's evergreen and always up to date, with AI-powered and automated features that optimize performance and durability for you. Serverless compute and Hyperscale storage options automatically scale resources on demand, so you can focus on building new applications without worrying about storage size or resource management.
Azure SQL Managed Instance is a fully managed SQL Server Database engine instance that's hosted in Azure and placed in your network. This deployment model makes it easy to lift and shift your on-premises applications to the cloud with very few application and database changes. Managed instance has split compute and storage components.
Azure Synapse Analytics is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless or provisioned resources at scale. It brings together the best of the SQL technologies used in enterprise data warehousing, Spark technologies used in big data analytics, and Pipelines for data integration and ETL/ELT.
MSSQL for Visual Studio Code is an extension for developing Microsoft SQL Server, Azure SQL Database and SQL Data Warehouse everywhere with a rich set of functionalities.
SQL Server Data Tools (SSDT) is a development tool for building SQL Server relational databases, Azure SQL Databases, Analysis Services (AS) data models, Integration Services (IS) packages, and Reporting Services (RS) reports. With SSDT, a developer can design and deploy any SQL Server content type with the same ease as they would develop an application in Visual Studio or Visual Studio Code.
Bulk Copy Program is a command-line tool that comes with Microsoft SQL Server. BCP, allows you to import and export large amounts of data in and out of SQL Server databases quickly snd efficeiently.
SQL Server Migration Assistant is a tool from Microsoft that simplifies database migration process from Oracle to SQL Server, Azure SQL Database, Azure SQL Database Managed Instance and Azure SQL Data Warehouse.
SQL Server Integration Services is a development platform for building enterprise-level data integration and data transformations solutions. Use Integration Services to solve complex business problems by copying or downloading files, loading data warehouses, cleansing and mining data, and managing SQL Server objects and data.
SQL Server Business Intelligence(BI) is a collection of tools in Microsoft's SQL Server for transforming raw data into information businesses can use to make decisions.
Tableau is a Data Visualization software used in relational databases, cloud databases, and spreadsheets. Tableau was acquired by Salesforce in August 2019.
DataGrip is a professional DataBase IDE developed by Jet Brains that provides context-sensitive code completion, helping you to write SQL code faster. Completion is aware of the tables structure, foreign keys, and even database objects created in code you're editing.
RStudio is an integrated development environment for R and Python, with a console, syntax-highlighting editor that supports direct code execution, and tools for plotting, history, debugging and workspace management.
MySQL is a fully managed database service to deploy cloud-native applications using the world's most popular open source database.
PostgreSQL is a powerful, open source object-relational database system with over 30 years of active development that has earned it a strong reputation for reliability, feature robustness, and performance.
Amazon DynamoDB is a key-value and document database that delivers single-digit millisecond performance at any scale. It is a fully managed, multiregion, multimaster, durable database with built-in security, backup and restore, and in-memory caching for internet-scale applications.
FoundationDB is an open source distributed database designed to handle large volumes of structured data across clusters of commodity servers. It organizes data as an ordered key-value store and employs ACID transactions for all operations. It is especially well-suited for read/write workloads but also has excellent performance for write-intensive workloads. FoundationDB was acquired by Apple in 2015.
CouchbaseDB is an open source distributed multi-model NoSQL document-oriented database. It creates a key-value store with managed cache for sub-millisecond data operations, with purpose-built indexers for efficient queries and a powerful query engine for executing SQL queries.
IBM DB2 is a collection of hybrid data management products offering a complete suite of AI-empowered capabilities designed to help you manage both structured and unstructured data on premises as well as in private and public cloud environments. Db2 is built on an intelligent common SQL engine designed for scalability and flexibility.
MongoDB is a document database meaning it stores data in JSON-like documents.
OracleDB is a powerful fully managed database helps developers manage business-critical data with the highest availability, reliability, and security.
MariaDB is an enterprise open source database solution for modern, mission-critical applications.
SQLite is a C-language library that implements a small, fast, self-contained, high-reliability, full-featured, SQL database engine.SQLite is the most used database engine in the world. SQLite is built into all mobile phones and most computers and comes bundled inside countless other applications that people use every day.
SQLite Database Browser is an open source SQL tool that allows users to create, design and edits SQLite database files. It lets users show a log of all the SQL commands that have been issued by them and by the application itself.
dbWatch is a complete database monitoring/management solution for SQL Server, Oracle, PostgreSQL, Sybase, MySQL and Azure. Designed for proactive management and automation of routine maintenance in large scale on-premise, hybrid/cloud database environments.
Cosmos DB Profiler is a real-time visual debugger allowing a development team to gain valuable insight and perspective into their usage of Cosmos DB database. It identifies over a dozen suspicious behaviors from your application's interaction with Cosmos DB.
Adminer is an SQL management client tool for managing databases, tables, relations, indexes, users. Adminer has support for all the popular database management systems such as MySQL, MariaDB, PostgreSQL, SQLite, MS SQL, Oracle, Firebird, SimpleDB, Elasticsearch and MongoDB.
DBeaver is an open source database tool for developers and database administrators. It offers supports for JDBC compliant databases such as MySQL, Oracle, IBM DB2, SQL Server, Firebird, SQLite, Sybase, Teradata, Firebird, Apache Hive, Phoenix, and Presto.
DbVisualizer is a SQL management tool that allows users to manage a wide range of databases such as Oracle, Sybase, SQL Server, MySQL, H3, and SQLite.
AppDynamics Database is a management product for Microsoft SQL Server. With AppDynamics you can monitor and trend key performance metrics such as resource consumption, database objects, schema statistics and more, allowing you to proactively tune and fix issues in a High-Volume Production Environment.
Toad is a SQL Server DBMS toolset developed by Quest. It increases productivity by using extensive automation, intuitive workflows, and built-in expertise. This SQL management tool resolve issues, manage change and promote the highest levels of code quality for both relational and non-relational databases.
Lepide SQL Server is an open source storage manager utility to analyse the performance of SQL Servers. It provides a complete overview of all configuration and permission changes being made to your SQL Server environment through an easy-to-use, graphical user interface.
Sequel Pro is a fast MacOS database management tool for working with MySQL. This SQL management tool helpful for interacting with your database by easily to adding new databases, new tables, and new rows.
Back to the Top
Note: GNOME Extenions allow you customize your Desktop layout anyway you want.
Easily turn GNOME Extensions On/Off using the GNOME Shell integration add-on in the Firefox web browser.
Caffeine is a GNOME Shell extension that disables the screensaver and auto suspend
Arc Menu is a GNOME Shell extension that adds an Application Menu for GNOME.
Material Shell is a GNOME Shell extension that adds a modern desktop interface for Linux - packaged as an extension for GNOME Shell. Improve your user experience and get rid of the anarchy of traditional desktop workflows. Designed to simplify navigation and reduce the need to manipulate windows in order to improve productivity. It's meant to be 100% predictable and bring the benefits of tools coveted by professionals to everyone.
Clipboard Indicator is a GNOME Shell extension that adds a clipboard indicator to the top panel, and caches clipboard history.
Blur My Shell is a GNOME Shell extension that adds a blur look to different parts of the GNOME Shell, including the top panel, dash and overview.
GSConnect is a GNOME Shell extension that adds a complete implementation of KDE Connect especially for GNOME Shell with Nautilus, Chrome and Firefox integration. It does not rely on the KDE Connect desktop application and will not work with it installed.
Compiz alike windows effect is a GNOME Shell extension that adds wobbly windows effect inspired by the Compiz one
CPU Power Manager is a GNOME Shell extension that enables you to manage Intel_pstate CPU Frequency scaling driver.
CPU Power Governor is a GNOME Shell extension that enables the ability to swap between kernel governors for the CPU useful for laptops.
CPUFreq is a GNOME Shell extension for System Monitor and Power Manager.
Dash to Panel is a GNOME Shell extension that shows an icon taskbar for the Gnome Shell. This extension moves the dash into the gnome main panel so that the application launchers and system tray are combined into a single panel, similar to that found in KDE Plasma and Windows 7+. A separate dock is no longer needed for easy access to running and favorited applications.
Dash to Dock is a GNOME Shell extension that shows a dock for the Gnome Shell. This extension moves the dash out of the overview transforming it in a dock for an easier launching of applications and a faster switching between windows and desktops. Side and bottom placement options are available.
Removable Drive Menu is a GNOME Shell extension that shows a status menu for accessing and unmounting removable devices.
Snap Manager is a GNOME Shell extension that shows a popup menu in the top bar to easily manage snap tasks (list, changes, refresh, remove, install...). Update notification at session startup.
Sound Input & Output Device Chooser is a GNOME Shell extension that shows a list of sound output and input devices (similar to gnome sound settings) in the status menu below the volume slider. Various active ports like HDMI , Speakers etc. of the same device are also displayed for selection. V20+ needs python as dependency. If you want to continue with the old method without Python, use options to switch off New Port identification. But it works with only English
User Themes is a GNOME Shell extension that lets you load shell themes from user directory.
WinTile: Windows 10 window tiling for GNOME is a hotkey driven window tiling system for GNOME that imitates the standard Win-Arrow keys of Windows 10, allowing you to maximize, maximize to sides, or 1/4 sized to corner across a single or multiple monitors using just Super+Arrow.
Gnome Extensions Sync is a GNOME Shell extension that syncs gnome shell keybindings, tweaks settings and extensions with their configuration across all gnome installations.
Tray Icons: Reloaded is a GNOME Shell extension which bring back Tray Icons to top panel, with additional features.
GitLab extension is a GNOME Shell extension that lets you utilizes the official GitLab API to provide a comfortable overview about your projects, commits & pipelines.
Back to the Top
Distributed under the Creative Commons Attribution 4.0 International (CC BY 4.0) Public License.
