DevOps Archives - John Hanley

Google OAuth 2.0 – Testing with Curl – Refresh Access Token

In my earlier article on how to test Google OAuth 2.0 flows from the command line I showed how to generate Google OAuth 2.0 Access Token, Refresh Token, and ID Token. In this article, I will show how to refresh… Continue Reading →

Google OAuth 2.0 – Testing with Curl – Version 2

If you have ever wanted to test Google OAuth 2.0 flows from the command line, you will like this short article. This article is the second version. I wrote a previous article on using curl, but that version did not… Continue Reading →

January 14, 2019 3

Google Cloud IAM – Listing Projects

This article shows how to display a list of Google Cloud Projects that you have access to list. This article includes two examples in Python that use two different Google Cloud Python libraries. These examples produce the same output as the… Continue Reading →

January 13, 2019 0

Google Cloud – Creating OAuth Access Tokens for REST API Calls

The following example shows several important steps to call Google Cloud APIs without using an SDK in Python. Similar code works in just about any language (c#, java, php, nodejs). Change the source code with the filename of your service… Continue Reading →

December 25, 2018 5

Google Cloud – Converting Service Account Credentials from P12 to Json Format

I have written a number of articles about Google Cloud Credentials. For Service Account credentials, there are two on-disk formats: P12 and Json. This article shows how to convert these credentials from P12 to Json.

############################################################
# Version 1.00
# Date Created: 2018-12-22
# Last Update:  2018-12-22
# https://www2.jhanley.com
# Copyright (c) 2018, John J. Hanley
# Author: John Hanley
############################################################

'''
This program converts Google Service Account credentials from P12 format
into Json format. The critical items to know:
	Service Account Email address that matches the service account credentials. If this
		is wrong, the credentials won't work (P12 or Json).
	Project ID.
	P12 Password.
'''

import json
import OpenSSL.crypto

# This is the output file with the generated service account credentials from P12 credentials
json_filename = 'service-account.json'

# Details on the Google Service Account. The email must match the Google Console.
project_id = 'development-123456'
sa_filename = 'compute-engine.p12'
sa_password = 'notasecret'
sa_email = 'development-123456@developer.gserviceaccount.com'

# client_id is the 'Unique ID' in the Google Console under 'Service account details'
# This value is unique per service account email
# Optional

client_id = '123456789064738430393'

# pkey_id is the 'Key ID' in the Google Console under 'Service account details'
# This value is unique per key. One serice account can have more than one key issued
# Optional

pkey_id = 'e13865c612a34567abcdef1a8753d1c6789abcdb'

def load_private_key(p12_path, p12_password):
	''' Read the private key and return as base64 encoded '''

	# print('Opening:', p12_path)
	with open(p12_path, 'rb') as f:
		data = f.read()

	# print('Loading P12 (PFX) contents:')
	p12 = OpenSSL.crypto.load_pkcs12(data, p12_password)

	# Dump the Private Key in PKCS#1 PEM format
	key = OpenSSL.crypto.dump_privatekey(
			OpenSSL.crypto.FILETYPE_PEM,
			p12.get_privatekey())

	# return the private key
	return key

def my_encode(s):
	''' This routine encodes the Json 'client_x509_cert_url' '''
	# Replace @ with %40
	return s.replace('@', '%40')

# Generate the cert_url
cert_url = 'https://www.googleapis.com/robot/v1/metadata/x509/' + sa_email

# Load the private key from P12
pkey = load_private_key(sa_filename, sa_password)

# Json that will be writting to json_filename
sa = {
	"type": "service_account",
	"project_id": project_id,
	"private_key_id": pkey_id,
	"private_key": pkey.decode('utf-8'),
	"client_email": sa_email,
	"client_id": client_id,
	"auth_uri": "https://accounts.google.com/o/oauth2/auth",
	"token_uri": "https://oauth2.googleapis.com/token",
	"auth_provider_x509_cert_url": "https://www.googleapis.com/oauth2/v1/certs",
	"client_x509_cert_url": my_encode(cert_url)
}

with open(json_filename, 'w') as outfile:
	json.dump(sa, outfile, indent=2)

############################################################

# Version 1.00

# Date Created: 2018-12-22

# Last Update: 2018-12-22

# https://www2.jhanley.com

# Author: John Hanley

############################################################

'''

This program converts Google Service Account credentials from P12 format

into Json format. The critical items to know:

Service Account Email address that matches the service account credentials. If this

is wrong, the credentials won't work (P12 or Json).

Project ID.

P12 Password.

'''

import json

import OpenSSL.crypto

# This is the output file with the generated service account credentials from P12 credentials

json_filename = 'service-account.json'

# Details on the Google Service Account. The email must match the Google Console.

project_id = 'development-123456'

sa_filename = 'compute-engine.p12'

sa_password = 'notasecret'

sa_email = 'development-123456@developer.gserviceaccount.com'

# client_id is the 'Unique ID' in the Google Console under 'Service account details'

# This value is unique per service account email

# Optional

client_id = '123456789064738430393'

# pkey_id is the 'Key ID' in the Google Console under 'Service account details'

# This value is unique per key. One serice account can have more than one key issued

# Optional

pkey_id = 'e13865c612a34567abcdef1a8753d1c6789abcdb'

def load_private_key(p12_path, p12_password):

''' Read the private key and return as base64 encoded '''

# print('Opening:', p12_path)

with open(p12_path, 'rb') as f:

data = f.read()

# print('Loading P12 (PFX) contents:')

p12 = OpenSSL.crypto.load_pkcs12(data, p12_password)

# Dump the Private Key in PKCS#1 PEM format

key = OpenSSL.crypto.dump_privatekey(

OpenSSL.crypto.FILETYPE_PEM,

p12.get_privatekey())

# return the private key

return key

def my_encode(s):

''' This routine encodes the Json 'client_x509_cert_url' '''

# Replace @ with %40

return s.replace('@', '%40')

# Generate the cert_url

cert_url = 'https://www.googleapis.com/robot/v1/metadata/x509/' + sa_email

# Load the private key from P12

pkey = load_private_key(sa_filename, sa_password)

# Json that will be writting to json_filename

sa = {

"type": "service_account",

"project_id": project_id,

"private_key_id": pkey_id,

"private_key": pkey.decode('utf-8'),

"client_email": sa_email,

"client_id": client_id,

"auth_uri": "https://accounts.google.com/o/oauth2/auth",

"token_uri": "https://oauth2.googleapis.com/token",

"auth_provider_x509_cert_url": "https://www.googleapis.com/oauth2/v1/certs",

"client_x509_cert_url": my_encode(cert_url)

}

with open(json_filename, 'w') as outfile:

json.dump(sa, outfile, indent=2)

John HanleyI design… Continue Reading →

December 22, 2018 0

Google Cloud – Extracting Private Key from Service Account P12 Credentials

Google Service Account Credentials are available in two file formats: Json and P12. P12 is also known as PFX. The following code shows how to process a P12 file and split into Private Key and Certificate. This code also works… Continue Reading →

December 22, 2018 0

Google Cloud – Creating Access Tokens from Service Account P12 Credentials

Google Service Account Credentials are available in two file formats: Json and P12. P12 is also known as PFX. The following code shows how to use P12 credentials to list the buckets in Google Cloud Storage without using an SDK…. Continue Reading →

December 21, 2018 2

Google Cloud Stackdriver – IP Addresses

I have worked with Google Cloud Stackdriver for about three months. The more I learn about Stackdriver the more I like it. Great product for logging, monitoring, error reporting, application tracing and application debugging and more. One of the items… Continue Reading →

December 19, 2018 0

Google OAuth 2.0 – Testing with Curl

Introduction If you have ever wanted to test Google OAuth 2.0 flows from the command-line, you will like this short article. [Update: I thought about the problem below with the copy and paste requirement. I created a simple python web… Continue Reading →

November 17, 2018 5

Google Cloud – Creating and Authorizing Service Account Credentials with the CLI

This article is written for Windows, but the same principles apply to Linux and Mac. A service account is a special Google account that is used with applications or services, such as Google Compute Engine. Service account credentials are stored… Continue Reading →

November 4, 2018 1

Google Cloud – Setting up Gcloud with Service Account Credentials

In this article, we will download and install the Google gcloud CLI. Then we will set up gcloud with Google Service Account credentials. This article is for Windows-based systems but the same principles apply to Linux and Mac systems. Step… Continue Reading →

November 2, 2018 1

Google Cloud – Understanding Gcloud Configurations

This article is written for Windows, but the same principles apply to Linux and Mac. I need to work with multiple Google Cloud accounts and be able to easily switch my credentials between accounts. For those of you with AWS… Continue Reading →

November 1, 2018 0

Google Cloud Private DNS Zones

On October 23, 2018, Google introduced private DNS zones for Google Cloud DNS. This is an important announcement as this keeps internal DNS names private. Today’s article covers how to implement this new feature in Google Cloud Platform. Update: May… Continue Reading →

October 29, 2018 8

Security, software development and devops in a cloud world

Category DevOps