What IP addresses does GitHub use that I should whitelist?

Current IP Addresses

Github currently serves applications via the following IP address range. Note: This is in CIDR notation.

• 192.30.252.0/22

In order to access all of our services, please ensure that TCP ports 22, 80, 443, and 9418 are allowed via the IP range above.

These IPs may change (or be added to) in the future, and we will keep this page up to date.

Mockito All Bundles with Hamcrest = DERP.

This is just a rehash and rant related to the following excellent post at:

https://tedvinke.wordpress.com/2013/12/17/mixing-junit-hamcrest-and-mockito-explaining-nosuchmethoderror/

This could be due to the fact that JUnit itself brings along its own version of Hamcrest as a transitive dependency. Now if you would be using JUnit 4.11 it would depending on Hamcrest 1.3 already – see here. Getting above error would be weird – since the describeMismatch method is present in org.hamcrest.Matcher interface. --Ted Vinke

	testCompile ('junit:junit:4.11') {
	exclude group: 'org.hamcrest', module: 'hamcrest-all'
	}

view raw exclude_hamcrest.gradle hosted with ❤ by GitHub

	java.lang.NoSuchMethodError: org/hamcrest/Matcher.describeMismatch(Ljava/lang/Object;Lorg/hamcrest/Description;)V
	at org.hamcrest.collection.IsIterableContainingInOrder$MatchSeries.describeMismatch(IsIterableContainingInOrder.java:83)
	at org.hamcrest.collection.IsIterableContainingInOrder$MatchSeries.isMatched(IsIterableContainingInOrder.java:66)
	at org.hamcrest.collection.IsIterableContainingInOrder$MatchSeries.matches(IsIterableContainingInOrder.java:52)
	at org.hamcrest.collection.IsIterableContainingInOrder.matchesSafely(IsIterableContainingInOrder.java:25)
	at org.hamcrest.collection.IsIterableContainingInOrder.matchesSafely(IsIterableContainingInOrder.java:14)
	at org.hamcrest.TypeSafeDiagnosingMatcher.matches(TypeSafeDiagnosingMatcher.java:55)
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:12)
	at org.junit.Assert.assertThat(Assert.java:865)

view raw hamcrest_error.txt hosted with ❤ by GitHub

	$ jar tf /Users/cgra12/.m2/repository/org/mockito/mockito-all/1.9.5/mockito-all-1.9.5.jar|grep hamcrest
	org/hamcrest/
	org/hamcrest/core/
	org/hamcrest/internal/
	hamcrest-license.txt
	org/hamcrest/BaseDescription.class
	org/hamcrest/BaseDescription.java
	org/hamcrest/BaseMatcher.class
	org/hamcrest/BaseMatcher.java
	org/hamcrest/CoreMatchers.class
	org/hamcrest/CoreMatchers.java
	org/hamcrest/Description.class
	org/hamcrest/Description.java
	org/hamcrest/Factory.class
	org/hamcrest/Factory.java
	org/hamcrest/Matcher.class
	org/hamcrest/Matcher.java
	org/hamcrest/SelfDescribing.class
	org/hamcrest/SelfDescribing.java
	org/hamcrest/StringDescription.class
	org/hamcrest/StringDescription.java
	org/hamcrest/core/AllOf.class
	org/hamcrest/core/AllOf.java
	org/hamcrest/core/AnyOf.class
	org/hamcrest/core/AnyOf.java
	org/hamcrest/core/DescribedAs.class
	org/hamcrest/core/DescribedAs.java
	org/hamcrest/core/Is.class
	org/hamcrest/core/Is.java
	org/hamcrest/core/IsAnything.class
	org/hamcrest/core/IsAnything.java
	org/hamcrest/core/IsEqual.class
	org/hamcrest/core/IsEqual.java
	org/hamcrest/core/IsInstanceOf.class
	org/hamcrest/core/IsInstanceOf.java
	org/hamcrest/core/IsNot.class
	org/hamcrest/core/IsNot.java
	org/hamcrest/core/IsNull.class
	org/hamcrest/core/IsNull.java
	org/hamcrest/core/IsSame.class
	org/hamcrest/core/IsSame.java
	org/hamcrest/core/package.html
	org/hamcrest/internal/ArrayIterator.class
	org/hamcrest/internal/ArrayIterator.java
	org/hamcrest/internal/SelfDescribingValue.class
	org/hamcrest/internal/SelfDescribingValue.java
	org/hamcrest/internal/SelfDescribingValueIterator.class
	org/hamcrest/internal/SelfDescribingValueIterator.java
	org/hamcrest/package.html

view raw listjar.sh hosted with ❤ by GitHub

This is extremely discouraging that BOTH Junit and Mockito would embed hidden transitive dependencies that are almost impossible to find without looking into the contents of the jars in the classpath.


SHAME ON YOU

Filtering without Lambda or Java 8

I wanted a way to filter generally without using Lambda or Java 8.

	public class CollectionsUtils {
	public static void remove(List<?> items, Filter<Object> filter) {
	Iterator<?> iterator = items.iterator();
	while (iterator.hasNext()) {
	if (filter.shouldRemove(iterator.next())) {
	iterator.remove();
	}
	}
	}
	}

view raw CollectionUtils.java hosted with ❤ by GitHub

	public interface Filter<T> {
	public boolean shouldRemove(T t);
	}

view raw Filter.java hosted with ❤ by GitHub

	List<Map.Entry<String, Object>> list = new ArrayList<Map.Entry<String, Object>>(entries);
	//remove negative values
	CollectionsUtils.remove(list, new Filter<Object>() {
	public boolean shouldRemove(Object o1) {
	Map.Entry<String, Object> entry = (Map.Entry<String, Object>)o1;
	Double d1 = Double.parseDouble(entry.getValue().toString());
	return d1<0.25;
	}
	});

view raw FilteredMap.java hosted with ❤ by GitHub

File path from Class Relative

determine current filesystem location of executed class from the code of this class, in runtime, given that it's executed using java command?

	final File f = new File(
	MyClass.class
	.getProtectionDomain()
	.getCodeSource()
	.getLocation().getPath());

view raw Filepath.java hosted with ❤ by GitHub

http://stackoverflow.com/questions/11747833/getting-filesystem-path-of-class-being-executed

Creating CORS Web Service for AngularJS

CORS is the ability to allow cross domains scripting. This can be important if you say want to host your website on S3 and have those pages access web services in EC2. I spent TONS of time trying to find how to configure AngularJS to use CORS and what I generally saw was people saying...

"You need to configure the server side for access control, not the client."

Well that's not entirely true.

The example I am using is based on the Spring, Jersey, run-as-ajar example you can find on GitHub. So lets start with the server side then:

	@GET
	@Path("/dates/{ticker}")
	@Produces("application/json")
	public Response getStatements(@PathParam("ticker") String ticker) {
	try {
	CompanyStatements companyStatements = fundamentalsDao.getStatementsForCompany(ticker);
	GsonBuilder gsonBuilder = new GsonBuilder();
	gsonBuilder.registerTypeAdapter(Date.class, new DronzeDateSerializer());
	Gson gson = gsonBuilder.create();
	String json = gson.toJson(companyStatements);
	return Response.status(Status.OK).entity(json)
	.header("Access-Control-Allow-Origin", "*")
	.header("Access-Control-Allow-Headers", "Content-Type")
	.header("Access-Control-Allow-Methods", "GET, POST, OPTIONS")
	.build();
	} catch (Exception e) {
	logger.error(e.getMessage(),e);
	return Response.status(Status.INTERNAL_SERVER_ERROR)
	.entity(getErrorJson())
	.build();
	}
	}

view raw CorsResource.java hosted with ❤ by GitHub

And here is the client side...

	<!DOCTYPE html>
	<html ng-app="dronzeApp">
	<head>
	<title>Hello World, AngularJS - ViralPatel.net</title>
	<script type="text/javascript"
	src="//ajax.googleapis.com/ajax/libs/angularjs/1.0.7/angular.min.js"></script>
	<script type="text/javascript">
	var dronzeApp = angular.module('dronzeApp', []);
	dronzeApp.config(function($httpProvider) {
	//Enable cross domain calls
	$httpProvider.defaults.useXDomain = true;
	//Remove the header containing XMLHttpRequest used to identify ajax call
	//that would prevent CORS from working
	delete $httpProvider.defaults.headers.common['X-Requested-With'];
	});
	dronzeApp.controller('CompanyStatements', function ($scope, $http) {
	$http.get('http://ec2-52-24-100-54.us-west-2.compute.amazonaws.com:8080/rest/api/statement/dates/AAN')
	.success(function(data) {
	$scope.statements = data;
	});
	});
	</script>
	</head>
	<body>
	<div ng-controller="CompanyStatements">
	<div>Statement ticker: {{statements.ticker}}</div>
	<ul>
	<li ng-repeat="date in statements.statementDates">
	<span>{{date}}</span>
	</li>
	</ul>
	<p>Total number of statements: {{statements.statementDates.length}}</p>
	</div>
	</body>
	</html>

view raw corsclient.html hosted with ❤ by GitHub

Jenkins Home

[ec2-user ~]$ sudo su -s /bin/bash jenkins bash-4.2$

log4j Configuration

Here is the basic log4j configuration I use with all the basics. Hope this helps.

	package com.claytantor.log4j.playground;
	import org.apache.log4j.Logger;
	/**
	* Created by cgra12 on 8/24/15.
	*/
	public class HelloLog4j {
	static Logger log = Logger.getLogger(HelloLog4j.class.getName());
	public static void main(String[] args){
	log.debug("Hello log4j");
	}
	}

view raw HelloLog4j.java hosted with ❤ by GitHub

	<?xml version="1.0" encoding="UTF-8" ?>
	<!DOCTYPE log4j:configuration SYSTEM "log4j.dtd">
	<log4j:configuration xmlns:log4j="http://jakarta.apache.org/log4j/">
	<appender name="console" class="org.apache.log4j.ConsoleAppender">
	<param name="Target" value="System.out"/>
	<layout class="org.apache.log4j.PatternLayout">
	<param name="ConversionPattern" value="%-5p %c{1} - %m%n"/>
	</layout>
	</appender>
	<root>
	<priority value ="debug" />
	<appender-ref ref="console" />
	</root>
	</log4j:configuration>

view raw log4j.xml hosted with ❤ by GitHub

	<?xml version="1.0" encoding="UTF-8"?>
	<project xmlns="http://maven.apache.org/POM/4.0.0"
	xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
	xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
	<modelVersion>4.0.0</modelVersion>
	<groupId>com.claytantor.log4j</groupId>
	<artifactId>log4j-playground</artifactId>
	<version>1.0-SNAPSHOT</version>
	<dependencies>
	<!--
	old approach but verified
	slf4j-api-1.6.1.jar
	slf4j-log4j12-1.6.1.jar
	log4j-1.2.16.jar
	-->
	<dependency>
	<groupId>org.apache.logging.log4j</groupId>
	<artifactId>log4j-core</artifactId>
	<version>2.3</version>
	</dependency>
	<dependency>
	<groupId>org.slf4j</groupId>
	<artifactId>slf4j-log4j12</artifactId>
	<version>1.7.12</version>
	</dependency>
	<dependency>
	<groupId>org.slf4j</groupId>
	<artifactId>slf4j-api</artifactId>
	<version>1.7.12</version>
	</dependency>
	</dependencies>
	</project>

view raw pom.xml hosted with ❤ by GitHub

Binary Tree Search Solution

I hate face2face interview problems. I am horrible at them. I need the mental space of the IDE to work out the problem and think about it, something I dont do well in interviews.

Ah the classic interview question. Recurse Binary Trees. I don't know why they just love to give this one but I have some time off so I thought I would solve it. This is for a github project where I will point interviewers at so maybe they will just believe I can do this stuff.

The key to this is to check the other node in the recursion of the find or it will go down the right or left leg and get lost. There are some good Data Structures articles on BTS that I used to come to this solution. Here you go:

• http://cslibrary.stanford.edu/110/BinaryTrees.html
• http://opendatastructures.org/ods-java/6_1_BinaryTree_Basic_Binary.html

	/**
	* will return a null value if a match cant be found. You have to search
	* both ways or it will get lost on the right or left directions. This is
	* a classic "gotcha"
	*
	* @param root
	* @param nodeId
	* @return
	*/
	public BinaryTreeNode searchNodeById(BinaryTreeNode root, Integer nodeId){
	if(root.getId().equals(nodeId)) {
	return root;
	} else if (root.getLeft() != null) {
	BinaryTreeNode node = searchNodeById(root.getLeft(),nodeId);
	if(node == null){
	return searchNodeById(root.getRight(),nodeId);
	} else {
	return node;
	}
	} else if (root.getRight() != null) {
	BinaryTreeNode node = searchNodeById(root.getRight(),nodeId);
	if(node == null){
	return searchNodeById(root.getLeft(),nodeId);
	} else {
	return node;
	}
	} else {
	return null;
	}
	}

view raw gistfile1.java hosted with ❤ by GitHub

AWS SSL Cert with Load Balancer Issues

I have been having all kinds of problems figuring out how to use SSL with AWS Load balancers in a way that keeps users from being redirected in weird ways that look like the site has problems or dropping them out of SSL. The only way I have found that lets you do SSL without being a complete expert is to install the cert on a load balancer and then proxy to port 80. This can have some unexpected outcomes *(see bottom section)

Really would appreciate help configuring either my load balancer, domain records, or the apache2 server to make this behave more professionally.

Overview

http://docs.aws.amazon.com/ElasticLoadBalancing/latest/DeveloperGuide/US_UpdatingLoadBalancerSSL.html

1. Generate CSR
2. Get a Comodo cert
3. Cert must be PEM encoded
4. Create Load Balancer
5. Install CERT
6. Modify Host Records

Generate a CSR

https://support.comodo.com/index.php?/Knowledgebase/Article/View/1/19/csr-generation-using-openssl-apache-wmod_ssl-nginx-os-x

	$ openssl req -nodes -newkey rsa:2048 -keyout mysite_com.key -out mysite_com.csr
	Generating a 2048 bit RSA private key
	.........................+++
	.................................................................+++
	writing new private key to 'mysite_com.key'
	-----
	You are about to be asked to enter information that will be incorporated
	into your certificate request.
	What you are about to enter is what is called a Distinguished Name or a DN.
	There are quite a few fields but you can leave some blank
	For some fields there will be a default value,
	If you enter '.', the field will be left blank.
	-----
	Country Name (2 letter code) [XX]:US
	State or Province Name (full name) []:California
	Locality Name (eg, city) [Default City]:Oakland
	Organization Name (eg, company) [Default Company Ltd]:Mysite
	Organizational Unit Name (eg, section) []:IT
	Common Name (eg, your name or your server's hostname) []:mysite.com
	Email Address []:clay@mysite.com

view raw csr_text.txt hosted with ❤ by GitHub

Two Files will be Created:

• mysite_com.csr
• mysite_com.key

Get Comodo Cert

• AddTrustExternalCARoot.crt
• COMODORSAAddTrustCA.crt
• COMODORSADomainValidationSecureServerCA.crt
• mysite_com.crt

Cert and Key Must be RSA PEM encoded

Failed to upload SSL certificate: java.lang.ClassCastException: org.bouncycastle.asn1.pkcs.PrivateKeyInfo cannot be cast to org.bouncycastle.openssl.PEMKeyPair

$ openssl rsa -in mysite_com.key -text > mysite_com_pem.key

http://stackoverflow.com/questions/991758/how-to-get-an-openssl-pem-file-from-key-and-crt-files

Install CERT

http://docs.aws.amazon.com/ElasticLoadBalancing/latest/DeveloperGuide/US_UpdatingLoadBalancerSSL.html

Private Key:* Use a text editor and copy the contents of mysite_com_pem.key

Public Key Certificate:* Use a text editor and copy the contents of mysite_com.crt

Successfully created load balancer

Load balancer mysitecom-lb was successfully created.Note: It may take a few minutes for your instances to become active in the new load balancer.

Modify Host Records

@ https://www.mysite.com Record Type: URL Redirect
www mysite-lb-1551430537.us-east-1.elb.amazonaws.com. Record Type: CName

Problems with this approach

1. https://www.mysite.com is properly certified and encrypted (not a problem)
2. There is no cert for the named domain https://mysite.com, in fact DNS doesnt know how to resolve to ssl version of the naked domain at all.
3. The non naked version of http://mysite.com does redirect to https://www.mysite.com, while it is good that it redirects to an encrypted version it would be better if it redirected to the SSL based naked domain of https://mysite.com
4. http://www.mysite.com/ does not redirect, it should redirect to https://www.mysite.com/