SConstruct revision 10607
1955SN/A# -*- mode:python -*-
2955SN/A
35871Snate@binkert.org# Copyright (c) 2013 ARM Limited
41762SN/A# All rights reserved.
5955SN/A#
6955SN/A# The license below extends only to copyright in the software and shall
7955SN/A# not be construed as granting a license to any other intellectual
8955SN/A# property including but not limited to intellectual property relating
9955SN/A# to a hardware implementation of the functionality of the software
10955SN/A# licensed hereunder.  You may use the software subject to the license
11955SN/A# terms below provided that you ensure that this notice is replicated
12955SN/A# unmodified and in its entirety in all distributions of the software,
13955SN/A# modified or unmodified, in source code or in binary form.
14955SN/A#
15955SN/A# Copyright (c) 2011 Advanced Micro Devices, Inc.
16955SN/A# Copyright (c) 2009 The Hewlett-Packard Development Company
17955SN/A# Copyright (c) 2004-2005 The Regents of The University of Michigan
18955SN/A# All rights reserved.
19955SN/A#
20955SN/A# Redistribution and use in source and binary forms, with or without
21955SN/A# modification, are permitted provided that the following conditions are
22955SN/A# met: redistributions of source code must retain the above copyright
23955SN/A# notice, this list of conditions and the following disclaimer;
24955SN/A# redistributions in binary form must reproduce the above copyright
25955SN/A# notice, this list of conditions and the following disclaimer in the
26955SN/A# documentation and/or other materials provided with the distribution;
27955SN/A# neither the name of the copyright holders nor the names of its
28955SN/A# contributors may be used to endorse or promote products derived from
292665Ssaidi@eecs.umich.edu# this software without specific prior written permission.
302665Ssaidi@eecs.umich.edu#
315863Snate@binkert.org# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
32955SN/A# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
33955SN/A# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
34955SN/A# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
35955SN/A# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
36955SN/A# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
372632Sstever@eecs.umich.edu# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
382632Sstever@eecs.umich.edu# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
392632Sstever@eecs.umich.edu# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
402632Sstever@eecs.umich.edu# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
41955SN/A# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
422632Sstever@eecs.umich.edu#
432632Sstever@eecs.umich.edu# Authors: Steve Reinhardt
442761Sstever@eecs.umich.edu#          Nathan Binkert
452632Sstever@eecs.umich.edu
462632Sstever@eecs.umich.edu###################################################
472632Sstever@eecs.umich.edu#
482761Sstever@eecs.umich.edu# SCons top-level build description (SConstruct) file.
492761Sstever@eecs.umich.edu#
502761Sstever@eecs.umich.edu# While in this directory ('gem5'), just type 'scons' to build the default
512632Sstever@eecs.umich.edu# configuration (see below), or type 'scons build/<CONFIG>/<binary>'
522632Sstever@eecs.umich.edu# to build some other configuration (e.g., 'build/ALPHA/gem5.opt' for
532761Sstever@eecs.umich.edu# the optimized full-system version).
542761Sstever@eecs.umich.edu#
552761Sstever@eecs.umich.edu# You can build gem5 in a different directory as long as there is a
562761Sstever@eecs.umich.edu# 'build/<CONFIG>' somewhere along the target path.  The build system
572761Sstever@eecs.umich.edu# expects that all configs under the same build directory are being
582632Sstever@eecs.umich.edu# built for the same host system.
592632Sstever@eecs.umich.edu#
602632Sstever@eecs.umich.edu# Examples:
612632Sstever@eecs.umich.edu#
622632Sstever@eecs.umich.edu#   The following two commands are equivalent.  The '-u' option tells
632632Sstever@eecs.umich.edu#   scons to search up the directory tree for this SConstruct file.
642632Sstever@eecs.umich.edu#   % cd <path-to-src>/gem5 ; scons build/ALPHA/gem5.debug
65955SN/A#   % cd <path-to-src>/gem5/build/ALPHA; scons -u gem5.debug
66955SN/A#
67955SN/A#   The following two commands are equivalent and demonstrate building
685863Snate@binkert.org#   in a directory outside of the source tree.  The '-C' option tells
695863Snate@binkert.org#   scons to chdir to the specified directory to find this SConstruct
705863Snate@binkert.org#   file.
715863Snate@binkert.org#   % cd <path-to-src>/gem5 ; scons /local/foo/build/ALPHA/gem5.debug
725863Snate@binkert.org#   % cd /local/foo/build/ALPHA; scons -C <path-to-src>/gem5 gem5.debug
735863Snate@binkert.org#
745863Snate@binkert.org# You can use 'scons -H' to print scons options.  If you're in this
755863Snate@binkert.org# 'gem5' directory (or use -u or -C to tell scons where to find this
765863Snate@binkert.org# file), you can use 'scons -h' to print all the gem5-specific build
775863Snate@binkert.org# options as well.
785863Snate@binkert.org#
795863Snate@binkert.org###################################################
805863Snate@binkert.org
815863Snate@binkert.org# Check for recent-enough Python and SCons versions.
825863Snate@binkert.orgtry:
835863Snate@binkert.org    # Really old versions of scons only take two options for the
845863Snate@binkert.org    # function, so check once without the revision and once with the
855863Snate@binkert.org    # revision, the first instance will fail for stuff other than
865863Snate@binkert.org    # 0.98, and the second will fail for 0.98.0
875863Snate@binkert.org    EnsureSConsVersion(0, 98)
885863Snate@binkert.org    EnsureSConsVersion(0, 98, 1)
895863Snate@binkert.orgexcept SystemExit, e:
905863Snate@binkert.org    print """
915863Snate@binkert.orgFor more details, see:
925863Snate@binkert.org    http://gem5.org/Dependencies
935863Snate@binkert.org"""
945863Snate@binkert.org    raise
955863Snate@binkert.org
965863Snate@binkert.org# We ensure the python version early because because python-config
975863Snate@binkert.org# requires python 2.5
985863Snate@binkert.orgtry:
99955SN/A    EnsurePythonVersion(2, 5)
1005396Ssaidi@eecs.umich.eduexcept SystemExit, e:
1015863Snate@binkert.org    print """
1025863Snate@binkert.orgYou can use a non-default installation of the Python interpreter by
1034202Sbinkertn@umich.edurearranging your PATH so that scons finds the non-default 'python' and
1045863Snate@binkert.org'python-config' first.
1055863Snate@binkert.org
1065863Snate@binkert.orgFor more details, see:
1075863Snate@binkert.org    http://gem5.org/wiki/index.php/Using_a_non-default_Python_installation
108955SN/A"""
1095273Sstever@gmail.com    raise
1105871Snate@binkert.org
1115273Sstever@gmail.com# Global Python includes
1125871Snate@binkert.orgimport itertools
1135863Snate@binkert.orgimport os
1145863Snate@binkert.orgimport re
1155863Snate@binkert.orgimport subprocess
1165871Snate@binkert.orgimport sys
1175872Snate@binkert.org
1185872Snate@binkert.orgfrom os import mkdir, environ
1195872Snate@binkert.orgfrom os.path import abspath, basename, dirname, expanduser, normpath
1205871Snate@binkert.orgfrom os.path import exists,  isdir, isfile
1215871Snate@binkert.orgfrom os.path import join as joinpath, split as splitpath
1225871Snate@binkert.org
1235871Snate@binkert.org# SCons includes
1245871Snate@binkert.orgimport SCons
1255871Snate@binkert.orgimport SCons.Node
1265871Snate@binkert.org
1275871Snate@binkert.orgextra_python_paths = [
1285871Snate@binkert.org    Dir('src/python').srcnode().abspath, # gem5 includes
1295871Snate@binkert.org    Dir('ext/ply').srcnode().abspath, # ply is used by several files
1305871Snate@binkert.org    ]
1315871Snate@binkert.org
1325871Snate@binkert.orgsys.path[1:1] = extra_python_paths
1335871Snate@binkert.org
1345863Snate@binkert.orgfrom m5.util import compareVersions, readCommand
1355227Ssaidi@eecs.umich.edufrom m5.util.terminal import get_termcap
1365396Ssaidi@eecs.umich.edu
1375396Ssaidi@eecs.umich.eduhelp_texts = {
1385396Ssaidi@eecs.umich.edu    "options" : "",
1395396Ssaidi@eecs.umich.edu    "global_vars" : "",
1405396Ssaidi@eecs.umich.edu    "local_vars" : ""
1415396Ssaidi@eecs.umich.edu}
1425396Ssaidi@eecs.umich.edu
1435396Ssaidi@eecs.umich.eduExport("help_texts")
1445588Ssaidi@eecs.umich.edu
1455396Ssaidi@eecs.umich.edu
1465396Ssaidi@eecs.umich.edu# There's a bug in scons in that (1) by default, the help texts from
1475396Ssaidi@eecs.umich.edu# AddOption() are supposed to be displayed when you type 'scons -h'
1485396Ssaidi@eecs.umich.edu# and (2) you can override the help displayed by 'scons -h' using the
1495396Ssaidi@eecs.umich.edu# Help() function, but these two features are incompatible: once
1505396Ssaidi@eecs.umich.edu# you've overridden the help text using Help(), there's no way to get
1515396Ssaidi@eecs.umich.edu# at the help texts from AddOptions.  See:
1525396Ssaidi@eecs.umich.edu#     http://scons.tigris.org/issues/show_bug.cgi?id=2356
1535396Ssaidi@eecs.umich.edu#     http://scons.tigris.org/issues/show_bug.cgi?id=2611
1545396Ssaidi@eecs.umich.edu# This hack lets us extract the help text from AddOptions and
1555396Ssaidi@eecs.umich.edu# re-inject it via Help().  Ideally someday this bug will be fixed and
1565396Ssaidi@eecs.umich.edu# we can just use AddOption directly.
1575396Ssaidi@eecs.umich.edudef AddLocalOption(*args, **kwargs):
1585396Ssaidi@eecs.umich.edu    col_width = 30
1595871Snate@binkert.org
1605871Snate@binkert.org    help = "  " + ", ".join(args)
1615871Snate@binkert.org    if "help" in kwargs:
1625871Snate@binkert.org        length = len(help)
1635871Snate@binkert.org        if length >= col_width:
1646003Snate@binkert.org            help += "\n" + " " * col_width
1656003Snate@binkert.org        else:
166955SN/A            help += " " * (col_width - length)
1675871Snate@binkert.org        help += kwargs["help"]
1685871Snate@binkert.org    help_texts["options"] += help + "\n"
1695871Snate@binkert.org
1705871Snate@binkert.org    AddOption(*args, **kwargs)
171955SN/A
1725871Snate@binkert.orgAddLocalOption('--colors', dest='use_colors', action='store_true',
1735871Snate@binkert.org               help="Add color to abbreviated scons output")
1745871Snate@binkert.orgAddLocalOption('--no-colors', dest='use_colors', action='store_false',
1751533SN/A               help="Don't add color to abbreviated scons output")
1765871Snate@binkert.orgAddLocalOption('--with-cxx-config', dest='with_cxx_config',
1775871Snate@binkert.org               action='store_true',
1785863Snate@binkert.org               help="Build with support for C++-based configuration")
1795871Snate@binkert.orgAddLocalOption('--default', dest='default', type='string', action='store',
1805871Snate@binkert.org               help='Override which build_opts file to use for defaults')
1815871Snate@binkert.orgAddLocalOption('--ignore-style', dest='ignore_style', action='store_true',
1825871Snate@binkert.org               help='Disable style checking hooks')
1835871Snate@binkert.orgAddLocalOption('--no-lto', dest='no_lto', action='store_true',
1845863Snate@binkert.org               help='Disable Link-Time Optimization for fast')
1855871Snate@binkert.orgAddLocalOption('--update-ref', dest='update_ref', action='store_true',
1865863Snate@binkert.org               help='Update test reference outputs')
1875871Snate@binkert.orgAddLocalOption('--verbose', dest='verbose', action='store_true',
1884678Snate@binkert.org               help='Print full tool command lines')
1894678Snate@binkert.orgAddLocalOption('--without-python', dest='without_python',
1904678Snate@binkert.org               action='store_true',
1914678Snate@binkert.org               help='Build without Python configuration support')
1924678Snate@binkert.orgAddLocalOption('--without-tcmalloc', dest='without_tcmalloc',
1934678Snate@binkert.org               action='store_true',
1944678Snate@binkert.org               help='Disable linking against tcmalloc')
1954678Snate@binkert.orgAddLocalOption('--with-ubsan', dest='with_ubsan', action='store_true',
1964678Snate@binkert.org               help='Build with Undefined Behavior Sanitizer if available')
1974678Snate@binkert.org
1984678Snate@binkert.orgtermcap = get_termcap(GetOption('use_colors'))
1994678Snate@binkert.org
2005871Snate@binkert.org########################################################################
2014678Snate@binkert.org#
2025871Snate@binkert.org# Set up the main build environment.
2035871Snate@binkert.org#
2045871Snate@binkert.org########################################################################
2055871Snate@binkert.org
2065871Snate@binkert.org# export TERM so that clang reports errors in color
2075871Snate@binkert.orguse_vars = set([ 'AS', 'AR', 'CC', 'CXX', 'HOME', 'LD_LIBRARY_PATH',
2085871Snate@binkert.org                 'LIBRARY_PATH', 'PATH', 'PKG_CONFIG_PATH', 'PROTOC',
2095871Snate@binkert.org                 'PYTHONPATH', 'RANLIB', 'SWIG', 'TERM' ])
2105871Snate@binkert.org
2115871Snate@binkert.orguse_prefixes = [
2125871Snate@binkert.org    "M5",           # M5 configuration (e.g., path to kernels)
2135871Snate@binkert.org    "DISTCC_",      # distcc (distributed compiler wrapper) configuration
2145871Snate@binkert.org    "CCACHE_",      # ccache (caching compiler wrapper) configuration
2155990Ssaidi@eecs.umich.edu    "CCC_",         # clang static analyzer configuration
2165871Snate@binkert.org    ]
2175871Snate@binkert.org
2185871Snate@binkert.orguse_env = {}
2194678Snate@binkert.orgfor key,val in sorted(os.environ.iteritems()):
2205871Snate@binkert.org    if key in use_vars or \
2215871Snate@binkert.org            any([key.startswith(prefix) for prefix in use_prefixes]):
2225871Snate@binkert.org        use_env[key] = val
2235871Snate@binkert.org
2245871Snate@binkert.orgmain = Environment(ENV=use_env)
2255871Snate@binkert.orgmain.Decider('MD5-timestamp')
2265871Snate@binkert.orgmain.root = Dir(".")         # The current directory (where this file lives).
2275871Snate@binkert.orgmain.srcdir = Dir("src")     # The source directory
2285871Snate@binkert.org
2295871Snate@binkert.orgmain_dict_keys = main.Dictionary().keys()
2304678Snate@binkert.org
2315871Snate@binkert.org# Check that we have a C/C++ compiler
2324678Snate@binkert.orgif not ('CC' in main_dict_keys and 'CXX' in main_dict_keys):
2335871Snate@binkert.org    print "No C++ compiler installed (package g++ on Ubuntu and RedHat)"
2345871Snate@binkert.org    Exit(1)
2355871Snate@binkert.org
2365871Snate@binkert.org# Check that swig is present
2375871Snate@binkert.orgif not 'SWIG' in main_dict_keys:
2385871Snate@binkert.org    print "swig is not installed (package swig on Ubuntu and RedHat)"
2395871Snate@binkert.org    Exit(1)
2405871Snate@binkert.org
2415871Snate@binkert.org# add useful python code PYTHONPATH so it can be used by subprocesses
2425990Ssaidi@eecs.umich.edu# as well
2435863Snate@binkert.orgmain.AppendENVPath('PYTHONPATH', extra_python_paths)
244955SN/A
245955SN/A########################################################################
2462632Sstever@eecs.umich.edu#
2472632Sstever@eecs.umich.edu# Mercurial Stuff.
248955SN/A#
249955SN/A# If the gem5 directory is a mercurial repository, we should do some
250955SN/A# extra things.
251955SN/A#
2525863Snate@binkert.org########################################################################
253955SN/A
2542632Sstever@eecs.umich.eduhgdir = main.root.Dir(".hg")
2552632Sstever@eecs.umich.edu
2562632Sstever@eecs.umich.edumercurial_style_message = """
2572632Sstever@eecs.umich.eduYou're missing the gem5 style hook, which automatically checks your code
2582632Sstever@eecs.umich.eduagainst the gem5 style rules on hg commit and qrefresh commands.  This
2592632Sstever@eecs.umich.eduscript will now install the hook in your .hg/hgrc file.
2602632Sstever@eecs.umich.eduPress enter to continue, or ctrl-c to abort: """
2612632Sstever@eecs.umich.edu
2622632Sstever@eecs.umich.edumercurial_style_hook = """
2632632Sstever@eecs.umich.edu# The following lines were automatically added by gem5/SConstruct
2642632Sstever@eecs.umich.edu# to provide the gem5 style-checking hooks
2652632Sstever@eecs.umich.edu[extensions]
2662632Sstever@eecs.umich.edustyle = %s/util/style.py
2673718Sstever@eecs.umich.edu
2683718Sstever@eecs.umich.edu[hooks]
2693718Sstever@eecs.umich.edupretxncommit.style = python:style.check_style
2703718Sstever@eecs.umich.edupre-qrefresh.style = python:style.check_style
2713718Sstever@eecs.umich.edu# End of SConstruct additions
2725863Snate@binkert.org
2735863Snate@binkert.org""" % (main.root.abspath)
2743718Sstever@eecs.umich.edu
2753718Sstever@eecs.umich.edumercurial_lib_not_found = """
2765863Snate@binkert.orgMercurial libraries cannot be found, ignoring style hook.  If
2775863Snate@binkert.orgyou are a gem5 developer, please fix this and run the style
2783718Sstever@eecs.umich.eduhook. It is important.
2793718Sstever@eecs.umich.edu"""
2802634Sstever@eecs.umich.edu
2812634Sstever@eecs.umich.edu# Check for style hook and prompt for installation if it's not there.
2825863Snate@binkert.org# Skip this if --ignore-style was specified, there's no .hg dir to
2832638Sstever@eecs.umich.edu# install a hook in, or there's no interactive terminal to prompt.
2842632Sstever@eecs.umich.eduif not GetOption('ignore_style') and hgdir.exists() and sys.stdin.isatty():
2852632Sstever@eecs.umich.edu    style_hook = True
2862632Sstever@eecs.umich.edu    try:
2872632Sstever@eecs.umich.edu        from mercurial import ui
2882632Sstever@eecs.umich.edu        ui = ui.ui()
2892632Sstever@eecs.umich.edu        ui.readconfig(hgdir.File('hgrc').abspath)
2901858SN/A        style_hook = ui.config('hooks', 'pretxncommit.style', None) and \
2913716Sstever@eecs.umich.edu                     ui.config('hooks', 'pre-qrefresh.style', None)
2922638Sstever@eecs.umich.edu    except ImportError:
2932638Sstever@eecs.umich.edu        print mercurial_lib_not_found
2942638Sstever@eecs.umich.edu
2952638Sstever@eecs.umich.edu    if not style_hook:
2962638Sstever@eecs.umich.edu        print mercurial_style_message,
2972638Sstever@eecs.umich.edu        # continue unless user does ctrl-c/ctrl-d etc.
2982638Sstever@eecs.umich.edu        try:
2995863Snate@binkert.org            raw_input()
3005863Snate@binkert.org        except:
3015863Snate@binkert.org            print "Input exception, exiting scons.\n"
302955SN/A            sys.exit(1)
3035341Sstever@gmail.com        hgrc_path = '%s/.hg/hgrc' % main.root.abspath
3045341Sstever@gmail.com        print "Adding style hook to", hgrc_path, "\n"
3055863Snate@binkert.org        try:
3065341Sstever@gmail.com            hgrc = open(hgrc_path, 'a')
3074494Ssaidi@eecs.umich.edu            hgrc.write(mercurial_style_hook)
3084494Ssaidi@eecs.umich.edu            hgrc.close()
3095863Snate@binkert.org        except:
3101105SN/A            print "Error updating", hgrc_path
3112667Sstever@eecs.umich.edu            sys.exit(1)
3122667Sstever@eecs.umich.edu
3132667Sstever@eecs.umich.edu
3142667Sstever@eecs.umich.edu###################################################
3152667Sstever@eecs.umich.edu#
3162667Sstever@eecs.umich.edu# Figure out which configurations to set up based on the path(s) of
3175341Sstever@gmail.com# the target(s).
3185863Snate@binkert.org#
3195341Sstever@gmail.com###################################################
3205341Sstever@gmail.com
3215341Sstever@gmail.com# Find default configuration & binary.
3225863Snate@binkert.orgDefault(environ.get('M5_DEFAULT_BINARY', 'build/ALPHA/gem5.debug'))
3235341Sstever@gmail.com
3245341Sstever@gmail.com# helper function: find last occurrence of element in list
3255341Sstever@gmail.comdef rfind(l, elt, offs = -1):
3265863Snate@binkert.org    for i in range(len(l)+offs, 0, -1):
3275341Sstever@gmail.com        if l[i] == elt:
3285341Sstever@gmail.com            return i
3295341Sstever@gmail.com    raise ValueError, "element not found"
3305341Sstever@gmail.com
3315341Sstever@gmail.com# Take a list of paths (or SCons Nodes) and return a list with all
3325341Sstever@gmail.com# paths made absolute and ~-expanded.  Paths will be interpreted
3335341Sstever@gmail.com# relative to the launch directory unless a different root is provided
3345341Sstever@gmail.comdef makePathListAbsolute(path_list, root=GetLaunchDir()):
3355341Sstever@gmail.com    return [abspath(joinpath(root, expanduser(str(p))))
3365341Sstever@gmail.com            for p in path_list]
3375863Snate@binkert.org
3385341Sstever@gmail.com# Each target must have 'build' in the interior of the path; the
3395863Snate@binkert.org# directory below this will determine the build parameters.  For
3405341Sstever@gmail.com# example, for target 'foo/bar/build/ALPHA_SE/arch/alpha/blah.do' we
3415863Snate@binkert.org# recognize that ALPHA_SE specifies the configuration because it
3425863Snate@binkert.org# follow 'build' in the build path.
3435863Snate@binkert.org
3445397Ssaidi@eecs.umich.edu# The funky assignment to "[:]" is needed to replace the list contents
3455397Ssaidi@eecs.umich.edu# in place rather than reassign the symbol to a new list, which
3465341Sstever@gmail.com# doesn't work (obviously!).
3475341Sstever@gmail.comBUILD_TARGETS[:] = makePathListAbsolute(BUILD_TARGETS)
3485341Sstever@gmail.com
3495341Sstever@gmail.com# Generate a list of the unique build roots and configs that the
3505341Sstever@gmail.com# collected targets reference.
3515341Sstever@gmail.comvariant_paths = []
3525341Sstever@gmail.combuild_root = None
3535341Sstever@gmail.comfor t in BUILD_TARGETS:
3545863Snate@binkert.org    path_dirs = t.split('/')
3555341Sstever@gmail.com    try:
3565341Sstever@gmail.com        build_top = rfind(path_dirs, 'build', -2)
3575863Snate@binkert.org    except:
3585341Sstever@gmail.com        print "Error: no non-leaf 'build' dir found on target path", t
3595863Snate@binkert.org        Exit(1)
3605863Snate@binkert.org    this_build_root = joinpath('/',*path_dirs[:build_top+1])
3615341Sstever@gmail.com    if not build_root:
3625863Snate@binkert.org        build_root = this_build_root
3635863Snate@binkert.org    else:
3645341Sstever@gmail.com        if this_build_root != build_root:
3655863Snate@binkert.org            print "Error: build targets not under same build root\n"\
3665341Sstever@gmail.com                  "  %s\n  %s" % (build_root, this_build_root)
3675871Snate@binkert.org            Exit(1)
3685341Sstever@gmail.com    variant_path = joinpath('/',*path_dirs[:build_top+2])
3695742Snate@binkert.org    if variant_path not in variant_paths:
3705742Snate@binkert.org        variant_paths.append(variant_path)
3715742Snate@binkert.org
3725341Sstever@gmail.com# Make sure build_root exists (might not if this is the first build there)
3735742Snate@binkert.orgif not isdir(build_root):
3745742Snate@binkert.org    mkdir(build_root)
3755341Sstever@gmail.commain['BUILDROOT'] = build_root
3762632Sstever@eecs.umich.edu
3776016Snate@binkert.orgExport('main')
3785871Snate@binkert.org
3795871Snate@binkert.orgmain.SConsignFile(joinpath(build_root, "sconsign"))
3805871Snate@binkert.org
3815871Snate@binkert.org# Default duplicate option is to use hard links, but this messes up
3825871Snate@binkert.org# when you use emacs to edit a file in the target dir, as emacs moves
3835871Snate@binkert.org# file to file~ then copies to file, breaking the link.  Symbolic
3845871Snate@binkert.org# (soft) links work better.
3853942Ssaidi@eecs.umich.edumain.SetOption('duplicate', 'soft-copy')
3863940Ssaidi@eecs.umich.edu
3873918Ssaidi@eecs.umich.edu#
3883918Ssaidi@eecs.umich.edu# Set up global sticky variables... these are common to an entire build
3891858SN/A# tree (not specific to a particular build like ALPHA_SE)
3903918Ssaidi@eecs.umich.edu#
3913918Ssaidi@eecs.umich.edu
3923918Ssaidi@eecs.umich.eduglobal_vars_file = joinpath(build_root, 'variables.global')
3933918Ssaidi@eecs.umich.edu
3945571Snate@binkert.orgglobal_vars = Variables(global_vars_file, args=ARGUMENTS)
3953940Ssaidi@eecs.umich.edu
3963940Ssaidi@eecs.umich.eduglobal_vars.AddVariables(
3973918Ssaidi@eecs.umich.edu    ('CC', 'C compiler', environ.get('CC', main['CC'])),
3983918Ssaidi@eecs.umich.edu    ('CXX', 'C++ compiler', environ.get('CXX', main['CXX'])),
3993918Ssaidi@eecs.umich.edu    ('SWIG', 'SWIG tool', environ.get('SWIG', main['SWIG'])),
4003918Ssaidi@eecs.umich.edu    ('PROTOC', 'protoc tool', environ.get('PROTOC', 'protoc')),
4013918Ssaidi@eecs.umich.edu    ('BATCH', 'Use batch pool for build and tests', False),
4023918Ssaidi@eecs.umich.edu    ('BATCH_CMD', 'Batch pool submission command name', 'qdo'),
4035871Snate@binkert.org    ('M5_BUILD_CACHE', 'Cache built objects in this directory', False),
4043918Ssaidi@eecs.umich.edu    ('EXTRAS', 'Add extra directories to the compilation', '')
4053918Ssaidi@eecs.umich.edu    )
4063940Ssaidi@eecs.umich.edu
4073918Ssaidi@eecs.umich.edu# Update main environment with values from ARGUMENTS & global_vars_file
4083918Ssaidi@eecs.umich.eduglobal_vars.Update(main)
4095397Ssaidi@eecs.umich.eduhelp_texts["global_vars"] += global_vars.GenerateHelpText(main)
4105397Ssaidi@eecs.umich.edu
4115397Ssaidi@eecs.umich.edu# Save sticky variable settings back to current variables file
4125708Ssaidi@eecs.umich.eduglobal_vars.Save(global_vars_file, main)
4135708Ssaidi@eecs.umich.edu
4145708Ssaidi@eecs.umich.edu# Parse EXTRAS variable to build list of all directories where we're
4155708Ssaidi@eecs.umich.edu# look for sources etc.  This list is exported as extras_dir_list.
4165708Ssaidi@eecs.umich.edubase_dir = main.srcdir.abspath
4175397Ssaidi@eecs.umich.eduif main['EXTRAS']:
4181851SN/A    extras_dir_list = makePathListAbsolute(main['EXTRAS'].split(':'))
4191851SN/Aelse:
4201858SN/A    extras_dir_list = []
4215200Sstever@gmail.com
422955SN/AExport('base_dir')
4233053Sstever@eecs.umich.eduExport('extras_dir_list')
4243053Sstever@eecs.umich.edu
4253053Sstever@eecs.umich.edu# the ext directory should be on the #includes path
4263053Sstever@eecs.umich.edumain.Append(CPPPATH=[Dir('ext')])
4273053Sstever@eecs.umich.edu
4283053Sstever@eecs.umich.edudef strip_build_path(path, env):
4293053Sstever@eecs.umich.edu    path = str(path)
4305871Snate@binkert.org    variant_base = env['BUILDROOT'] + os.path.sep
4313053Sstever@eecs.umich.edu    if path.startswith(variant_base):
4324742Sstever@eecs.umich.edu        path = path[len(variant_base):]
4334742Sstever@eecs.umich.edu    elif path.startswith('build/'):
4343053Sstever@eecs.umich.edu        path = path[6:]
4353053Sstever@eecs.umich.edu    return path
4363053Sstever@eecs.umich.edu
4373053Sstever@eecs.umich.edu# Generate a string of the form:
4383053Sstever@eecs.umich.edu#   common/path/prefix/src1, src2 -> tgt1, tgt2
4393053Sstever@eecs.umich.edu# to print while building.
4403053Sstever@eecs.umich.educlass Transform(object):
4413053Sstever@eecs.umich.edu    # all specific color settings should be here and nowhere else
4423053Sstever@eecs.umich.edu    tool_color = termcap.Normal
4432667Sstever@eecs.umich.edu    pfx_color = termcap.Yellow
4444554Sbinkertn@umich.edu    srcs_color = termcap.Yellow + termcap.Bold
4454554Sbinkertn@umich.edu    arrow_color = termcap.Blue + termcap.Bold
4462667Sstever@eecs.umich.edu    tgts_color = termcap.Yellow + termcap.Bold
4474554Sbinkertn@umich.edu
4484554Sbinkertn@umich.edu    def __init__(self, tool, max_sources=99):
4494554Sbinkertn@umich.edu        self.format = self.tool_color + (" [%8s] " % tool) \
4504554Sbinkertn@umich.edu                      + self.pfx_color + "%s" \
4514554Sbinkertn@umich.edu                      + self.srcs_color + "%s" \
4524554Sbinkertn@umich.edu                      + self.arrow_color + " -> " \
4534554Sbinkertn@umich.edu                      + self.tgts_color + "%s" \
4544781Snate@binkert.org                      + termcap.Normal
4554554Sbinkertn@umich.edu        self.max_sources = max_sources
4564554Sbinkertn@umich.edu
4572667Sstever@eecs.umich.edu    def __call__(self, target, source, env, for_signature=None):
4584554Sbinkertn@umich.edu        # truncate source list according to max_sources param
4594554Sbinkertn@umich.edu        source = source[0:self.max_sources]
4604554Sbinkertn@umich.edu        def strip(f):
4614554Sbinkertn@umich.edu            return strip_build_path(str(f), env)
4622667Sstever@eecs.umich.edu        if len(source) > 0:
4634554Sbinkertn@umich.edu            srcs = map(strip, source)
4642667Sstever@eecs.umich.edu        else:
4654554Sbinkertn@umich.edu            srcs = ['']
4664554Sbinkertn@umich.edu        tgts = map(strip, target)
4672667Sstever@eecs.umich.edu        # surprisingly, os.path.commonprefix is a dumb char-by-char string
4685522Snate@binkert.org        # operation that has nothing to do with paths.
4695522Snate@binkert.org        com_pfx = os.path.commonprefix(srcs + tgts)
4705522Snate@binkert.org        com_pfx_len = len(com_pfx)
4715522Snate@binkert.org        if com_pfx:
4725522Snate@binkert.org            # do some cleanup and sanity checking on common prefix
4735522Snate@binkert.org            if com_pfx[-1] == ".":
4745522Snate@binkert.org                # prefix matches all but file extension: ok
4755522Snate@binkert.org                # back up one to change 'foo.cc -> o' to 'foo.cc -> .o'
4765522Snate@binkert.org                com_pfx = com_pfx[0:-1]
4775522Snate@binkert.org            elif com_pfx[-1] == "/":
4785522Snate@binkert.org                # common prefix is directory path: OK
4795522Snate@binkert.org                pass
4805522Snate@binkert.org            else:
4815522Snate@binkert.org                src0_len = len(srcs[0])
4825522Snate@binkert.org                tgt0_len = len(tgts[0])
4835522Snate@binkert.org                if src0_len == com_pfx_len:
4845522Snate@binkert.org                    # source is a substring of target, OK
4855522Snate@binkert.org                    pass
4865522Snate@binkert.org                elif tgt0_len == com_pfx_len:
4875522Snate@binkert.org                    # target is a substring of source, need to back up to
4885522Snate@binkert.org                    # avoid empty string on RHS of arrow
4895522Snate@binkert.org                    sep_idx = com_pfx.rfind(".")
4905522Snate@binkert.org                    if sep_idx != -1:
4915522Snate@binkert.org                        com_pfx = com_pfx[0:sep_idx]
4925522Snate@binkert.org                    else:
4935522Snate@binkert.org                        com_pfx = ''
4942638Sstever@eecs.umich.edu                elif src0_len > com_pfx_len and srcs[0][com_pfx_len] == ".":
4952638Sstever@eecs.umich.edu                    # still splitting at file extension: ok
4962638Sstever@eecs.umich.edu                    pass
4973716Sstever@eecs.umich.edu                else:
4985522Snate@binkert.org                    # probably a fluke; ignore it
4995522Snate@binkert.org                    com_pfx = ''
5005522Snate@binkert.org        # recalculate length in case com_pfx was modified
5015522Snate@binkert.org        com_pfx_len = len(com_pfx)
5025522Snate@binkert.org        def fmt(files):
5035522Snate@binkert.org            f = map(lambda s: s[com_pfx_len:], files)
5041858SN/A            return ', '.join(f)
5055227Ssaidi@eecs.umich.edu        return self.format % (com_pfx, fmt(srcs), fmt(tgts))
5065227Ssaidi@eecs.umich.edu
5075227Ssaidi@eecs.umich.eduExport('Transform')
5085227Ssaidi@eecs.umich.edu
5095227Ssaidi@eecs.umich.edu# enable the regression script to use the termcap
5105863Snate@binkert.orgmain['TERMCAP'] = termcap
5115227Ssaidi@eecs.umich.edu
5125227Ssaidi@eecs.umich.eduif GetOption('verbose'):
5135227Ssaidi@eecs.umich.edu    def MakeAction(action, string, *args, **kwargs):
5145227Ssaidi@eecs.umich.edu        return Action(action, *args, **kwargs)
5155227Ssaidi@eecs.umich.eduelse:
5165227Ssaidi@eecs.umich.edu    MakeAction = Action
5175227Ssaidi@eecs.umich.edu    main['CCCOMSTR']        = Transform("CC")
5185204Sstever@gmail.com    main['CXXCOMSTR']       = Transform("CXX")
5195204Sstever@gmail.com    main['ASCOMSTR']        = Transform("AS")
5205204Sstever@gmail.com    main['SWIGCOMSTR']      = Transform("SWIG")
5215204Sstever@gmail.com    main['ARCOMSTR']        = Transform("AR", 0)
5225204Sstever@gmail.com    main['LINKCOMSTR']      = Transform("LINK", 0)
5235204Sstever@gmail.com    main['RANLIBCOMSTR']    = Transform("RANLIB", 0)
5245204Sstever@gmail.com    main['M4COMSTR']        = Transform("M4")
5255204Sstever@gmail.com    main['SHCCCOMSTR']      = Transform("SHCC")
5265204Sstever@gmail.com    main['SHCXXCOMSTR']     = Transform("SHCXX")
5275204Sstever@gmail.comExport('MakeAction')
5285204Sstever@gmail.com
5295204Sstever@gmail.com# Initialize the Link-Time Optimization (LTO) flags
5305204Sstever@gmail.commain['LTO_CCFLAGS'] = []
5315204Sstever@gmail.commain['LTO_LDFLAGS'] = []
5325204Sstever@gmail.com
5335204Sstever@gmail.com# According to the readme, tcmalloc works best if the compiler doesn't
5345204Sstever@gmail.com# assume that we're using the builtin malloc and friends. These flags
5355204Sstever@gmail.com# are compiler-specific, so we need to set them after we detect which
5365204Sstever@gmail.com# compiler we're using.
5373118Sstever@eecs.umich.edumain['TCMALLOC_CCFLAGS'] = []
5383118Sstever@eecs.umich.edu
5393118Sstever@eecs.umich.eduCXX_version = readCommand([main['CXX'],'--version'], exception=False)
5403118Sstever@eecs.umich.eduCXX_V = readCommand([main['CXX'],'-V'], exception=False)
5413118Sstever@eecs.umich.edu
5425863Snate@binkert.orgmain['GCC'] = CXX_version and CXX_version.find('g++') >= 0
5433118Sstever@eecs.umich.edumain['CLANG'] = CXX_version and CXX_version.find('clang') >= 0
5445863Snate@binkert.orgif main['GCC'] + main['CLANG'] > 1:
5453118Sstever@eecs.umich.edu    print 'Error: How can we have two at the same time?'
5465863Snate@binkert.org    Exit(1)
5475863Snate@binkert.org
5485863Snate@binkert.org# Set up default C++ compiler flags
5495863Snate@binkert.orgif main['GCC'] or main['CLANG']:
5505863Snate@binkert.org    # As gcc and clang share many flags, do the common parts here
5515863Snate@binkert.org    main.Append(CCFLAGS=['-pipe'])
5525863Snate@binkert.org    main.Append(CCFLAGS=['-fno-strict-aliasing'])
5535863Snate@binkert.org    # Enable -Wall and then disable the few warnings that we
5546003Snate@binkert.org    # consistently violate
5555863Snate@binkert.org    main.Append(CCFLAGS=['-Wall', '-Wno-sign-compare', '-Wundef'])
5565863Snate@binkert.org    # We always compile using C++11, but only gcc >= 4.7 and clang 3.1
5575863Snate@binkert.org    # actually use that name, so we stick with c++0x
5585863Snate@binkert.org    main.Append(CXXFLAGS=['-std=c++0x'])
5595863Snate@binkert.org    # Add selected sanity checks from -Wextra
5605863Snate@binkert.org    main.Append(CXXFLAGS=['-Wmissing-field-initializers',
5615863Snate@binkert.org                          '-Woverloaded-virtual'])
5625863Snate@binkert.orgelse:
5635863Snate@binkert.org    print termcap.Yellow + termcap.Bold + 'Error' + termcap.Normal,
5645863Snate@binkert.org    print "Don't know what compiler options to use for your compiler."
5655863Snate@binkert.org    print termcap.Yellow + '       compiler:' + termcap.Normal, main['CXX']
5665863Snate@binkert.org    print termcap.Yellow + '       version:' + termcap.Normal,
5675863Snate@binkert.org    if not CXX_version:
5685863Snate@binkert.org        print termcap.Yellow + termcap.Bold + "COMMAND NOT FOUND!" +\
5695863Snate@binkert.org               termcap.Normal
5703118Sstever@eecs.umich.edu    else:
5715863Snate@binkert.org        print CXX_version.replace('\n', '<nl>')
5723118Sstever@eecs.umich.edu    print "       If you're trying to use a compiler other than GCC"
5733118Sstever@eecs.umich.edu    print "       or clang, there appears to be something wrong with your"
5745863Snate@binkert.org    print "       environment."
5755863Snate@binkert.org    print "       "
5765863Snate@binkert.org    print "       If you are trying to use a compiler other than those listed"
5775863Snate@binkert.org    print "       above you will need to ease fix SConstruct and "
5785863Snate@binkert.org    print "       src/SConscript to support that compiler."
5795863Snate@binkert.org    Exit(1)
5803118Sstever@eecs.umich.edu
5813483Ssaidi@eecs.umich.eduif main['GCC']:
5823494Ssaidi@eecs.umich.edu    # Check for a supported version of gcc. >= 4.6 is chosen for its
5833494Ssaidi@eecs.umich.edu    # level of c++11 support. See
5843483Ssaidi@eecs.umich.edu    # http://gcc.gnu.org/projects/cxx0x.html for details. 4.6 is also
5853483Ssaidi@eecs.umich.edu    # the first version with proper LTO support.
5863483Ssaidi@eecs.umich.edu    gcc_version = readCommand([main['CXX'], '-dumpversion'], exception=False)
5873053Sstever@eecs.umich.edu    if compareVersions(gcc_version, "4.6") < 0:
5883053Sstever@eecs.umich.edu        print 'Error: gcc version 4.6 or newer required.'
5893918Ssaidi@eecs.umich.edu        print '       Installed version:', gcc_version
5903053Sstever@eecs.umich.edu        Exit(1)
5913053Sstever@eecs.umich.edu
5923053Sstever@eecs.umich.edu    main['GCC_VERSION'] = gcc_version
5933053Sstever@eecs.umich.edu
5943053Sstever@eecs.umich.edu    # gcc from version 4.8 and above generates "rep; ret" instructions
5951858SN/A    # to avoid performance penalties on certain AMD chips. Older
5961858SN/A    # assemblers detect this as an error, "Error: expecting string
5971858SN/A    # instruction after `rep'"
5981858SN/A    if compareVersions(gcc_version, "4.8") > 0:
5991858SN/A        as_version = readCommand([main['AS'], '-v', '/dev/null'],
6001858SN/A                                 exception=False).split()
6015863Snate@binkert.org
6025863Snate@binkert.org        if not as_version or compareVersions(as_version[-1], "2.23") < 0:
6031859SN/A            print termcap.Yellow + termcap.Bold + \
6045863Snate@binkert.org                'Warning: This combination of gcc and binutils have' + \
6051858SN/A                ' known incompatibilities.\n' + \
6065863Snate@binkert.org                '         If you encounter build problems, please update ' + \
6071858SN/A                'binutils to 2.23.' + \
6081859SN/A                termcap.Normal
6091859SN/A
6105863Snate@binkert.org    # Make sure we warn if the user has requested to compile with the
6113053Sstever@eecs.umich.edu    # Undefined Benahvior Sanitizer and this version of gcc does not
6123053Sstever@eecs.umich.edu    # support it.
6133053Sstever@eecs.umich.edu    if GetOption('with_ubsan') and \
6143053Sstever@eecs.umich.edu            compareVersions(gcc_version, '4.9') < 0:
6151859SN/A        print termcap.Yellow + termcap.Bold + \
6161859SN/A            'Warning: UBSan is only supported using gcc 4.9 and later.' + \
6171859SN/A            termcap.Normal
6181859SN/A
6191859SN/A    # Add the appropriate Link-Time Optimization (LTO) flags
6201859SN/A    # unless LTO is explicitly turned off. Note that these flags
6211859SN/A    # are only used by the fast target.
6221859SN/A    if not GetOption('no_lto'):
6231862SN/A        # Pass the LTO flag when compiling to produce GIMPLE
6241859SN/A        # output, we merely create the flags here and only append
6251859SN/A        # them later
6261859SN/A        main['LTO_CCFLAGS'] = ['-flto=%d' % GetOption('num_jobs')]
6275863Snate@binkert.org
6285863Snate@binkert.org        # Use the same amount of jobs for LTO as we are running
6295863Snate@binkert.org        # scons with
6305863Snate@binkert.org        main['LTO_LDFLAGS'] = ['-flto=%d' % GetOption('num_jobs')]
6311858SN/A
6321858SN/A    main.Append(TCMALLOC_CCFLAGS=['-fno-builtin-malloc', '-fno-builtin-calloc',
6335863Snate@binkert.org                                  '-fno-builtin-realloc', '-fno-builtin-free'])
6345863Snate@binkert.org
6355863Snate@binkert.orgelif main['CLANG']:
6365863Snate@binkert.org    # Check for a supported version of clang, >= 3.0 is needed to
6375863Snate@binkert.org    # support similar features as gcc 4.6. See
6385871Snate@binkert.org    # http://clang.llvm.org/cxx_status.html for details
6395871Snate@binkert.org    clang_version_re = re.compile(".* version (\d+\.\d+)")
6402139SN/A    clang_version_match = clang_version_re.search(CXX_version)
6414202Sbinkertn@umich.edu    if (clang_version_match):
6424202Sbinkertn@umich.edu        clang_version = clang_version_match.groups()[0]
6432139SN/A        if compareVersions(clang_version, "3.0") < 0:
6442155SN/A            print 'Error: clang version 3.0 or newer required.'
6454202Sbinkertn@umich.edu            print '       Installed version:', clang_version
6464202Sbinkertn@umich.edu            Exit(1)
6474202Sbinkertn@umich.edu    else:
6482155SN/A        print 'Error: Unable to determine clang version.'
6495863Snate@binkert.org        Exit(1)
6501869SN/A
6511869SN/A    # clang has a few additional warnings that we disable,
6525863Snate@binkert.org    # tautological comparisons are allowed due to unsigned integers
6535863Snate@binkert.org    # being compared to constants that happen to be 0, and extraneous
6544202Sbinkertn@umich.edu    # parantheses are allowed due to Ruby's printing of the AST,
6555863Snate@binkert.org    # finally self assignments are allowed as the generated CPU code
6565863Snate@binkert.org    # is relying on this
6575863Snate@binkert.org    main.Append(CCFLAGS=['-Wno-tautological-compare',
6584202Sbinkertn@umich.edu                         '-Wno-parentheses',
6594202Sbinkertn@umich.edu                         '-Wno-self-assign',
6605863Snate@binkert.org                         # Some versions of libstdc++ (4.8?) seem to
6615742Snate@binkert.org                         # use struct hash and class hash
6625742Snate@binkert.org                         # interchangeably.
6635341Sstever@gmail.com                         '-Wno-mismatched-tags',
6645342Sstever@gmail.com                         ])
6655342Sstever@gmail.com
6664202Sbinkertn@umich.edu    main.Append(TCMALLOC_CCFLAGS=['-fno-builtin'])
6674202Sbinkertn@umich.edu
6684202Sbinkertn@umich.edu    # On Mac OS X/Darwin we need to also use libc++ (part of XCode) as
6694202Sbinkertn@umich.edu    # opposed to libstdc++, as the later is dated.
6704202Sbinkertn@umich.edu    if sys.platform == "darwin":
6715863Snate@binkert.org        main.Append(CXXFLAGS=['-stdlib=libc++'])
6725863Snate@binkert.org        main.Append(LIBS=['c++'])
6735863Snate@binkert.org
6745863Snate@binkert.orgelse:
6755863Snate@binkert.org    print termcap.Yellow + termcap.Bold + 'Error' + termcap.Normal,
6765863Snate@binkert.org    print "Don't know what compiler options to use for your compiler."
6775863Snate@binkert.org    print termcap.Yellow + '       compiler:' + termcap.Normal, main['CXX']
6785863Snate@binkert.org    print termcap.Yellow + '       version:' + termcap.Normal,
6795863Snate@binkert.org    if not CXX_version:
6805863Snate@binkert.org        print termcap.Yellow + termcap.Bold + "COMMAND NOT FOUND!" +\
6815863Snate@binkert.org               termcap.Normal
6825863Snate@binkert.org    else:
6835863Snate@binkert.org        print CXX_version.replace('\n', '<nl>')
6845863Snate@binkert.org    print "       If you're trying to use a compiler other than GCC"
6855863Snate@binkert.org    print "       or clang, there appears to be something wrong with your"
6865863Snate@binkert.org    print "       environment."
6875863Snate@binkert.org    print "       "
6885863Snate@binkert.org    print "       If you are trying to use a compiler other than those listed"
6895863Snate@binkert.org    print "       above you will need to ease fix SConstruct and "
6905863Snate@binkert.org    print "       src/SConscript to support that compiler."
6915952Ssaidi@eecs.umich.edu    Exit(1)
6921869SN/A
6931858SN/A# Set up common yacc/bison flags (needed for Ruby)
6945863Snate@binkert.orgmain['YACCFLAGS'] = '-d'
6955863Snate@binkert.orgmain['YACCHXXFILESUFFIX'] = '.hh'
6961869SN/A
6971858SN/A# Do this after we save setting back, or else we'll tack on an
6985863Snate@binkert.org# extra 'qdo' every time we run scons.
6995863Snate@binkert.orgif main['BATCH']:
7005863Snate@binkert.org    main['CC']     = main['BATCH_CMD'] + ' ' + main['CC']
7015863Snate@binkert.org    main['CXX']    = main['BATCH_CMD'] + ' ' + main['CXX']
7025952Ssaidi@eecs.umich.edu    main['AS']     = main['BATCH_CMD'] + ' ' + main['AS']
7031858SN/A    main['AR']     = main['BATCH_CMD'] + ' ' + main['AR']
704955SN/A    main['RANLIB'] = main['BATCH_CMD'] + ' ' + main['RANLIB']
705955SN/A
7061869SN/Aif sys.platform == 'cygwin':
7071869SN/A    # cygwin has some header file issues...
7081869SN/A    main.Append(CCFLAGS=["-Wno-uninitialized"])
7091869SN/A
7101869SN/A# Check for the protobuf compiler
7115863Snate@binkert.orgprotoc_version = readCommand([main['PROTOC'], '--version'],
7125863Snate@binkert.org                             exception='').split()
7135863Snate@binkert.org
7141869SN/A# First two words should be "libprotoc x.y.z"
7155863Snate@binkert.orgif len(protoc_version) < 2 or protoc_version[0] != 'libprotoc':
7161869SN/A    print termcap.Yellow + termcap.Bold + \
7175863Snate@binkert.org        'Warning: Protocol buffer compiler (protoc) not found.\n' + \
7181869SN/A        '         Please install protobuf-compiler for tracing support.' + \
7191869SN/A        termcap.Normal
7201869SN/A    main['PROTOC'] = False
7211869SN/Aelse:
7221869SN/A    # Based on the availability of the compress stream wrappers,
7235863Snate@binkert.org    # require 2.1.0
7245863Snate@binkert.org    min_protoc_version = '2.1.0'
7251869SN/A    if compareVersions(protoc_version[1], min_protoc_version) < 0:
7261869SN/A        print termcap.Yellow + termcap.Bold + \
7271869SN/A            'Warning: protoc version', min_protoc_version, \
7281869SN/A            'or newer required.\n' + \
7291869SN/A            '         Installed version:', protoc_version[1], \
7301869SN/A            termcap.Normal
7311869SN/A        main['PROTOC'] = False
7325863Snate@binkert.org    else:
7335863Snate@binkert.org        # Attempt to determine the appropriate include path and
7341869SN/A        # library path using pkg-config, that means we also need to
7355863Snate@binkert.org        # check for pkg-config. Note that it is possible to use
7365863Snate@binkert.org        # protobuf without the involvement of pkg-config. Later on we
7373356Sbinkertn@umich.edu        # check go a library config check and at that point the test
7383356Sbinkertn@umich.edu        # will fail if libprotobuf cannot be found.
7393356Sbinkertn@umich.edu        if readCommand(['pkg-config', '--version'], exception=''):
7403356Sbinkertn@umich.edu            try:
7413356Sbinkertn@umich.edu                # Attempt to establish what linking flags to add for protobuf
7424781Snate@binkert.org                # using pkg-config
7435863Snate@binkert.org                main.ParseConfig('pkg-config --cflags --libs-only-L protobuf')
7445863Snate@binkert.org            except:
7451869SN/A                print termcap.Yellow + termcap.Bold + \
7461869SN/A                    'Warning: pkg-config could not get protobuf flags.' + \
7471869SN/A                    termcap.Normal
7481869SN/A
7491869SN/A# Check for SWIG
7502638Sstever@eecs.umich.eduif not main.has_key('SWIG'):
7512638Sstever@eecs.umich.edu    print 'Error: SWIG utility not found.'
7525871Snate@binkert.org    print '       Please install (see http://www.swig.org) and retry.'
7532638Sstever@eecs.umich.edu    Exit(1)
7545749Scws3k@cs.virginia.edu
7555749Scws3k@cs.virginia.edu# Check for appropriate SWIG version
7565871Snate@binkert.orgswig_version = readCommand([main['SWIG'], '-version'], exception='').split()
7575749Scws3k@cs.virginia.edu# First 3 words should be "SWIG Version x.y.z"
7581869SN/Aif len(swig_version) < 3 or \
7591869SN/A        swig_version[0] != 'SWIG' or swig_version[1] != 'Version':
7603546Sgblack@eecs.umich.edu    print 'Error determining SWIG version.'
7613546Sgblack@eecs.umich.edu    Exit(1)
7623546Sgblack@eecs.umich.edu
7633546Sgblack@eecs.umich.edumin_swig_version = '2.0.4'
7644202Sbinkertn@umich.eduif compareVersions(swig_version[2], min_swig_version) < 0:
7655863Snate@binkert.org    print 'Error: SWIG version', min_swig_version, 'or newer required.'
7663546Sgblack@eecs.umich.edu    print '       Installed version:', swig_version[2]
7673546Sgblack@eecs.umich.edu    Exit(1)
7683546Sgblack@eecs.umich.edu
7693546Sgblack@eecs.umich.edu# Check for known incompatibilities. The standard library shipped with
7704781Snate@binkert.org# gcc >= 4.9 does not play well with swig versions prior to 3.0
7715863Snate@binkert.orgif main['GCC'] and compareVersions(gcc_version, '4.9') >= 0 and \
7724781Snate@binkert.org        compareVersions(swig_version[2], '3.0') < 0:
7734781Snate@binkert.org    print termcap.Yellow + termcap.Bold + \
7744781Snate@binkert.org        'Warning: This combination of gcc and swig have' + \
7754781Snate@binkert.org        ' known incompatibilities.\n' + \
7764781Snate@binkert.org        '         If you encounter build problems, please update ' + \
7775863Snate@binkert.org        'swig to 3.0 or later.' + \
7784781Snate@binkert.org        termcap.Normal
7794781Snate@binkert.org
7804781Snate@binkert.org# Set up SWIG flags & scanner
7814781Snate@binkert.orgswig_flags=Split('-c++ -python -modern -templatereduce $_CPPINCFLAGS')
7823546Sgblack@eecs.umich.edumain.Append(SWIGFLAGS=swig_flags)
7833546Sgblack@eecs.umich.edu
7843546Sgblack@eecs.umich.edu# Check for 'timeout' from GNU coreutils.  If present, regressions
7854781Snate@binkert.org# will be run with a time limit.
7863546Sgblack@eecs.umich.eduTIMEOUT_version = readCommand(['timeout', '--version'], exception=False)
7873546Sgblack@eecs.umich.edumain['TIMEOUT'] = TIMEOUT_version and TIMEOUT_version.find('timeout') == 0
7883546Sgblack@eecs.umich.edu
7893546Sgblack@eecs.umich.edu# filter out all existing swig scanners, they mess up the dependency
7903546Sgblack@eecs.umich.edu# stuff for some reason
7913546Sgblack@eecs.umich.eduscanners = []
7923546Sgblack@eecs.umich.edufor scanner in main['SCANNERS']:
7933546Sgblack@eecs.umich.edu    skeys = scanner.skeys
7943546Sgblack@eecs.umich.edu    if skeys == '.i':
7953546Sgblack@eecs.umich.edu        continue
7964202Sbinkertn@umich.edu
7973546Sgblack@eecs.umich.edu    if isinstance(skeys, (list, tuple)) and '.i' in skeys:
7983546Sgblack@eecs.umich.edu        continue
7993546Sgblack@eecs.umich.edu
800955SN/A    scanners.append(scanner)
801955SN/A
802955SN/A# add the new swig scanner that we like better
803955SN/Afrom SCons.Scanner import ClassicCPP as CPPScanner
8041858SN/Aswig_inc_re = '^[ \t]*[%,#][ \t]*(?:include|import)[ \t]*(<|")([^>"]+)(>|")'
8051858SN/Ascanners.append(CPPScanner("SwigScan", [ ".i" ], "CPPPATH", swig_inc_re))
8061858SN/A
8075863Snate@binkert.org# replace the scanners list that has what we want
8085863Snate@binkert.orgmain['SCANNERS'] = scanners
8095343Sstever@gmail.com
8105343Sstever@gmail.com# Add a custom Check function to the Configure context so that we can
8115863Snate@binkert.org# figure out if the compiler adds leading underscores to global
8125863Snate@binkert.org# variables.  This is needed for the autogenerated asm files that we
8134773Snate@binkert.org# use for embedding the python code.
8145863Snate@binkert.orgdef CheckLeading(context):
8152632Sstever@eecs.umich.edu    context.Message("Checking for leading underscore in global variables...")
8165863Snate@binkert.org    # 1) Define a global variable called x from asm so the C compiler
8172023SN/A    #    won't change the symbol at all.
8185863Snate@binkert.org    # 2) Declare that variable.
8195863Snate@binkert.org    # 3) Use the variable
8205863Snate@binkert.org    #
8215863Snate@binkert.org    # If the compiler prepends an underscore, this will successfully
8225863Snate@binkert.org    # link because the external symbol 'x' will be called '_x' which
8235863Snate@binkert.org    # was defined by the asm statement.  If the compiler does not
8245863Snate@binkert.org    # prepend an underscore, this will not successfully link because
8255863Snate@binkert.org    # '_x' will have been defined by assembly, while the C portion of
8265863Snate@binkert.org    # the code will be trying to use 'x'
8272632Sstever@eecs.umich.edu    ret = context.TryLink('''
8285863Snate@binkert.org        asm(".globl _x; _x: .byte 0");
8292023SN/A        extern int x;
8302632Sstever@eecs.umich.edu        int main() { return x; }
8315863Snate@binkert.org        ''', extension=".c")
8325342Sstever@gmail.com    context.env.Append(LEADING_UNDERSCORE=ret)
8335863Snate@binkert.org    context.Result(ret)
8342632Sstever@eecs.umich.edu    return ret
8355863Snate@binkert.org
8365863Snate@binkert.org# Add a custom Check function to test for structure members.
8372632Sstever@eecs.umich.edudef CheckMember(context, include, decl, member, include_quotes="<>"):
8385863Snate@binkert.org    context.Message("Checking for member %s in %s..." %
8395863Snate@binkert.org                    (member, decl))
8405863Snate@binkert.org    text = """
8415863Snate@binkert.org#include %(header)s
8425863Snate@binkert.orgint main(){
8435863Snate@binkert.org  %(decl)s test;
8442632Sstever@eecs.umich.edu  (void)test.%(member)s;
8455863Snate@binkert.org  return 0;
8465863Snate@binkert.org};
8472632Sstever@eecs.umich.edu""" % { "header" : include_quotes[0] + include + include_quotes[1],
8481888SN/A        "decl" : decl,
8495863Snate@binkert.org        "member" : member,
8505863Snate@binkert.org        }
8515863Snate@binkert.org
8521858SN/A    ret = context.TryCompile(text, extension=".cc")
8535863Snate@binkert.org    context.Result(ret)
8545863Snate@binkert.org    return ret
8555863Snate@binkert.org
8565863Snate@binkert.org# Platform-specific configuration.  Note again that we assume that all
8572598SN/A# builds under a given build root run on the same host platform.
8585863Snate@binkert.orgconf = Configure(main,
8591858SN/A                 conf_dir = joinpath(build_root, '.scons_config'),
8601858SN/A                 log_file = joinpath(build_root, 'scons_config.log'),
8611858SN/A                 custom_tests = {
8625863Snate@binkert.org        'CheckLeading' : CheckLeading,
8631858SN/A        'CheckMember' : CheckMember,
8641858SN/A        })
8651858SN/A
8665863Snate@binkert.org# Check for leading underscores.  Don't really need to worry either
8671871SN/A# way so don't need to check the return code.
8681858SN/Aconf.CheckLeading()
8691858SN/A
8701858SN/A# Check if we should compile a 64 bit binary on Mac OS X/Darwin
8711858SN/Atry:
8721858SN/A    import platform
8731858SN/A    uname = platform.uname()
8741858SN/A    if uname[0] == 'Darwin' and compareVersions(uname[2], '9.0.0') >= 0:
8755863Snate@binkert.org        if int(readCommand('sysctl -n hw.cpu64bit_capable')[0]):
8761858SN/A            main.Append(CCFLAGS=['-arch', 'x86_64'])
8771858SN/A            main.Append(CFLAGS=['-arch', 'x86_64'])
8785863Snate@binkert.org            main.Append(LINKFLAGS=['-arch', 'x86_64'])
8791859SN/A            main.Append(ASFLAGS=['-arch', 'x86_64'])
8801859SN/Aexcept:
8811869SN/A    pass
8825863Snate@binkert.org
8835863Snate@binkert.org# Recent versions of scons substitute a "Null" object for Configure()
8841869SN/A# when configuration isn't necessary, e.g., if the "--help" option is
8851965SN/A# present.  Unfortuantely this Null object always returns false,
8861965SN/A# breaking all our configuration checks.  We replace it with our own
8871965SN/A# more optimistic null object that returns True instead.
8882761Sstever@eecs.umich.eduif not conf:
8895863Snate@binkert.org    def NullCheck(*args, **kwargs):
8901869SN/A        return True
8915863Snate@binkert.org
8922667Sstever@eecs.umich.edu    class NullConf:
8931869SN/A        def __init__(self, env):
8941869SN/A            self.env = env
8952929Sktlim@umich.edu        def Finish(self):
8962929Sktlim@umich.edu            return self.env
8975863Snate@binkert.org        def __getattr__(self, mname):
8982929Sktlim@umich.edu            return NullCheck
899955SN/A
9002598SN/A    conf = NullConf(main)
901
902# Cache build files in the supplied directory.
903if main['M5_BUILD_CACHE']:
904    print 'Using build cache located at', main['M5_BUILD_CACHE']
905    CacheDir(main['M5_BUILD_CACHE'])
906
907if not GetOption('without_python'):
908    # Find Python include and library directories for embedding the
909    # interpreter. We rely on python-config to resolve the appropriate
910    # includes and linker flags. ParseConfig does not seem to understand
911    # the more exotic linker flags such as -Xlinker and -export-dynamic so
912    # we add them explicitly below. If you want to link in an alternate
913    # version of python, see above for instructions on how to invoke
914    # scons with the appropriate PATH set.
915    #
916    # First we check if python2-config exists, else we use python-config
917    python_config = readCommand(['which', 'python2-config'],
918                                exception='').strip()
919    if not os.path.exists(python_config):
920        python_config = readCommand(['which', 'python-config'],
921                                    exception='').strip()
922    py_includes = readCommand([python_config, '--includes'],
923                              exception='').split()
924    # Strip the -I from the include folders before adding them to the
925    # CPPPATH
926    main.Append(CPPPATH=map(lambda inc: inc[2:], py_includes))
927
928    # Read the linker flags and split them into libraries and other link
929    # flags. The libraries are added later through the call the CheckLib.
930    py_ld_flags = readCommand([python_config, '--ldflags'],
931        exception='').split()
932    py_libs = []
933    for lib in py_ld_flags:
934         if not lib.startswith('-l'):
935             main.Append(LINKFLAGS=[lib])
936         else:
937             lib = lib[2:]
938             if lib not in py_libs:
939                 py_libs.append(lib)
940
941    # verify that this stuff works
942    if not conf.CheckHeader('Python.h', '<>'):
943        print "Error: can't find Python.h header in", py_includes
944        print "Install Python headers (package python-dev on Ubuntu and RedHat)"
945        Exit(1)
946
947    for lib in py_libs:
948        if not conf.CheckLib(lib):
949            print "Error: can't find library %s required by python" % lib
950            Exit(1)
951
952# On Solaris you need to use libsocket for socket ops
953if not conf.CheckLibWithHeader(None, 'sys/socket.h', 'C++', 'accept(0,0,0);'):
954   if not conf.CheckLibWithHeader('socket', 'sys/socket.h', 'C++', 'accept(0,0,0);'):
955       print "Can't find library with socket calls (e.g. accept())"
956       Exit(1)
957
958# Check for zlib.  If the check passes, libz will be automatically
959# added to the LIBS environment variable.
960if not conf.CheckLibWithHeader('z', 'zlib.h', 'C++','zlibVersion();'):
961    print 'Error: did not find needed zlib compression library '\
962          'and/or zlib.h header file.'
963    print '       Please install zlib and try again.'
964    Exit(1)
965
966# If we have the protobuf compiler, also make sure we have the
967# development libraries. If the check passes, libprotobuf will be
968# automatically added to the LIBS environment variable. After
969# this, we can use the HAVE_PROTOBUF flag to determine if we have
970# got both protoc and libprotobuf available.
971main['HAVE_PROTOBUF'] = main['PROTOC'] and \
972    conf.CheckLibWithHeader('protobuf', 'google/protobuf/message.h',
973                            'C++', 'GOOGLE_PROTOBUF_VERIFY_VERSION;')
974
975# If we have the compiler but not the library, print another warning.
976if main['PROTOC'] and not main['HAVE_PROTOBUF']:
977    print termcap.Yellow + termcap.Bold + \
978        'Warning: did not find protocol buffer library and/or headers.\n' + \
979    '       Please install libprotobuf-dev for tracing support.' + \
980    termcap.Normal
981
982# Check for librt.
983have_posix_clock = \
984    conf.CheckLibWithHeader(None, 'time.h', 'C',
985                            'clock_nanosleep(0,0,NULL,NULL);') or \
986    conf.CheckLibWithHeader('rt', 'time.h', 'C',
987                            'clock_nanosleep(0,0,NULL,NULL);')
988
989have_posix_timers = \
990    conf.CheckLibWithHeader([None, 'rt'], [ 'time.h', 'signal.h' ], 'C',
991                            'timer_create(CLOCK_MONOTONIC, NULL, NULL);')
992
993if not GetOption('without_tcmalloc'):
994    if conf.CheckLib('tcmalloc'):
995        main.Append(CCFLAGS=main['TCMALLOC_CCFLAGS'])
996    elif conf.CheckLib('tcmalloc_minimal'):
997        main.Append(CCFLAGS=main['TCMALLOC_CCFLAGS'])
998    else:
999        print termcap.Yellow + termcap.Bold + \
1000              "You can get a 12% performance improvement by "\
1001              "installing tcmalloc (libgoogle-perftools-dev package "\
1002              "on Ubuntu or RedHat)." + termcap.Normal
1003
1004if not have_posix_clock:
1005    print "Can't find library for POSIX clocks."
1006
1007# Check for <fenv.h> (C99 FP environment control)
1008have_fenv = conf.CheckHeader('fenv.h', '<>')
1009if not have_fenv:
1010    print "Warning: Header file <fenv.h> not found."
1011    print "         This host has no IEEE FP rounding mode control."
1012
1013# Check if we should enable KVM-based hardware virtualization. The API
1014# we rely on exists since version 2.6.36 of the kernel, but somehow
1015# the KVM_API_VERSION does not reflect the change. We test for one of
1016# the types as a fall back.
1017have_kvm = conf.CheckHeader('linux/kvm.h', '<>') and \
1018    conf.CheckTypeSize('struct kvm_xsave', '#include <linux/kvm.h>') != 0
1019if not have_kvm:
1020    print "Info: Compatible header file <linux/kvm.h> not found, " \
1021        "disabling KVM support."
1022
1023# Check if the requested target ISA is compatible with the host
1024def is_isa_kvm_compatible(isa):
1025    isa_comp_table = {
1026        "arm" : ( "armv7l" ),
1027        "x86" : ( "x86_64" ),
1028        }
1029    try:
1030        import platform
1031        host_isa = platform.machine()
1032    except:
1033        print "Warning: Failed to determine host ISA."
1034        return False
1035
1036    return host_isa in isa_comp_table.get(isa, [])
1037
1038
1039# Check if the exclude_host attribute is available. We want this to
1040# get accurate instruction counts in KVM.
1041main['HAVE_PERF_ATTR_EXCLUDE_HOST'] = conf.CheckMember(
1042    'linux/perf_event.h', 'struct perf_event_attr', 'exclude_host')
1043
1044
1045######################################################################
1046#
1047# Finish the configuration
1048#
1049main = conf.Finish()
1050
1051######################################################################
1052#
1053# Collect all non-global variables
1054#
1055
1056# Define the universe of supported ISAs
1057all_isa_list = [ ]
1058Export('all_isa_list')
1059
1060class CpuModel(object):
1061    '''The CpuModel class encapsulates everything the ISA parser needs to
1062    know about a particular CPU model.'''
1063
1064    # Dict of available CPU model objects.  Accessible as CpuModel.dict.
1065    dict = {}
1066
1067    # Constructor.  Automatically adds models to CpuModel.dict.
1068    def __init__(self, name, default=False):
1069        self.name = name           # name of model
1070
1071        # This cpu is enabled by default
1072        self.default = default
1073
1074        # Add self to dict
1075        if name in CpuModel.dict:
1076            raise AttributeError, "CpuModel '%s' already registered" % name
1077        CpuModel.dict[name] = self
1078
1079Export('CpuModel')
1080
1081# Sticky variables get saved in the variables file so they persist from
1082# one invocation to the next (unless overridden, in which case the new
1083# value becomes sticky).
1084sticky_vars = Variables(args=ARGUMENTS)
1085Export('sticky_vars')
1086
1087# Sticky variables that should be exported
1088export_vars = []
1089Export('export_vars')
1090
1091# For Ruby
1092all_protocols = []
1093Export('all_protocols')
1094protocol_dirs = []
1095Export('protocol_dirs')
1096slicc_includes = []
1097Export('slicc_includes')
1098
1099# Walk the tree and execute all SConsopts scripts that wil add to the
1100# above variables
1101if GetOption('verbose'):
1102    print "Reading SConsopts"
1103for bdir in [ base_dir ] + extras_dir_list:
1104    if not isdir(bdir):
1105        print "Error: directory '%s' does not exist" % bdir
1106        Exit(1)
1107    for root, dirs, files in os.walk(bdir):
1108        if 'SConsopts' in files:
1109            if GetOption('verbose'):
1110                print "Reading", joinpath(root, 'SConsopts')
1111            SConscript(joinpath(root, 'SConsopts'))
1112
1113all_isa_list.sort()
1114
1115sticky_vars.AddVariables(
1116    EnumVariable('TARGET_ISA', 'Target ISA', 'alpha', all_isa_list),
1117    ListVariable('CPU_MODELS', 'CPU models',
1118                 sorted(n for n,m in CpuModel.dict.iteritems() if m.default),
1119                 sorted(CpuModel.dict.keys())),
1120    BoolVariable('EFENCE', 'Link with Electric Fence malloc debugger',
1121                 False),
1122    BoolVariable('SS_COMPATIBLE_FP',
1123                 'Make floating-point results compatible with SimpleScalar',
1124                 False),
1125    BoolVariable('USE_SSE2',
1126                 'Compile for SSE2 (-msse2) to get IEEE FP on x86 hosts',
1127                 False),
1128    BoolVariable('USE_POSIX_CLOCK', 'Use POSIX Clocks', have_posix_clock),
1129    BoolVariable('USE_FENV', 'Use <fenv.h> IEEE mode control', have_fenv),
1130    BoolVariable('CP_ANNOTATE', 'Enable critical path annotation capability', False),
1131    BoolVariable('USE_KVM', 'Enable hardware virtualized (KVM) CPU models', have_kvm),
1132    EnumVariable('PROTOCOL', 'Coherence protocol for Ruby', 'None',
1133                  all_protocols),
1134    )
1135
1136# These variables get exported to #defines in config/*.hh (see src/SConscript).
1137export_vars += ['USE_FENV', 'SS_COMPATIBLE_FP', 'TARGET_ISA', 'CP_ANNOTATE',
1138                'USE_POSIX_CLOCK', 'USE_KVM', 'PROTOCOL', 'HAVE_PROTOBUF',
1139                'HAVE_PERF_ATTR_EXCLUDE_HOST']
1140
1141###################################################
1142#
1143# Define a SCons builder for configuration flag headers.
1144#
1145###################################################
1146
1147# This function generates a config header file that #defines the
1148# variable symbol to the current variable setting (0 or 1).  The source
1149# operands are the name of the variable and a Value node containing the
1150# value of the variable.
1151def build_config_file(target, source, env):
1152    (variable, value) = [s.get_contents() for s in source]
1153    f = file(str(target[0]), 'w')
1154    print >> f, '#define', variable, value
1155    f.close()
1156    return None
1157
1158# Combine the two functions into a scons Action object.
1159config_action = MakeAction(build_config_file, Transform("CONFIG H", 2))
1160
1161# The emitter munges the source & target node lists to reflect what
1162# we're really doing.
1163def config_emitter(target, source, env):
1164    # extract variable name from Builder arg
1165    variable = str(target[0])
1166    # True target is config header file
1167    target = joinpath('config', variable.lower() + '.hh')
1168    val = env[variable]
1169    if isinstance(val, bool):
1170        # Force value to 0/1
1171        val = int(val)
1172    elif isinstance(val, str):
1173        val = '"' + val + '"'
1174
1175    # Sources are variable name & value (packaged in SCons Value nodes)
1176    return ([target], [Value(variable), Value(val)])
1177
1178config_builder = Builder(emitter = config_emitter, action = config_action)
1179
1180main.Append(BUILDERS = { 'ConfigFile' : config_builder })
1181
1182# libelf build is shared across all configs in the build root.
1183main.SConscript('ext/libelf/SConscript',
1184                variant_dir = joinpath(build_root, 'libelf'))
1185
1186# gzstream build is shared across all configs in the build root.
1187main.SConscript('ext/gzstream/SConscript',
1188                variant_dir = joinpath(build_root, 'gzstream'))
1189
1190# libfdt build is shared across all configs in the build root.
1191main.SConscript('ext/libfdt/SConscript',
1192                variant_dir = joinpath(build_root, 'libfdt'))
1193
1194# fputils build is shared across all configs in the build root.
1195main.SConscript('ext/fputils/SConscript',
1196                variant_dir = joinpath(build_root, 'fputils'))
1197
1198# DRAMSim2 build is shared across all configs in the build root.
1199main.SConscript('ext/dramsim2/SConscript',
1200                variant_dir = joinpath(build_root, 'dramsim2'))
1201
1202# DRAMPower build is shared across all configs in the build root.
1203main.SConscript('ext/drampower/SConscript',
1204                variant_dir = joinpath(build_root, 'drampower'))
1205
1206###################################################
1207#
1208# This function is used to set up a directory with switching headers
1209#
1210###################################################
1211
1212main['ALL_ISA_LIST'] = all_isa_list
1213all_isa_deps = {}
1214def make_switching_dir(dname, switch_headers, env):
1215    # Generate the header.  target[0] is the full path of the output
1216    # header to generate.  'source' is a dummy variable, since we get the
1217    # list of ISAs from env['ALL_ISA_LIST'].
1218    def gen_switch_hdr(target, source, env):
1219        fname = str(target[0])
1220        isa = env['TARGET_ISA'].lower()
1221        try:
1222            f = open(fname, 'w')
1223            print >>f, '#include "%s/%s/%s"' % (dname, isa, basename(fname))
1224            f.close()
1225        except IOError:
1226            print "Failed to create %s" % fname
1227            raise
1228
1229    # Build SCons Action object. 'varlist' specifies env vars that this
1230    # action depends on; when env['ALL_ISA_LIST'] changes these actions
1231    # should get re-executed.
1232    switch_hdr_action = MakeAction(gen_switch_hdr,
1233                          Transform("GENERATE"), varlist=['ALL_ISA_LIST'])
1234
1235    # Instantiate actions for each header
1236    for hdr in switch_headers:
1237        env.Command(hdr, [], switch_hdr_action)
1238
1239    isa_target = Dir('.').up().name.lower().replace('_', '-')
1240    env['PHONY_BASE'] = '#'+isa_target
1241    all_isa_deps[isa_target] = None
1242
1243Export('make_switching_dir')
1244
1245# all-isas -> all-deps -> all-environs -> all_targets
1246main.Alias('#all-isas', [])
1247main.Alias('#all-deps', '#all-isas')
1248
1249# Dummy target to ensure all environments are created before telling
1250# SCons what to actually make (the command line arguments).  We attach
1251# them to the dependence graph after the environments are complete.
1252ORIG_BUILD_TARGETS = list(BUILD_TARGETS) # force a copy; gets closure to work.
1253def environsComplete(target, source, env):
1254    for t in ORIG_BUILD_TARGETS:
1255        main.Depends('#all-targets', t)
1256
1257# Each build/* switching_dir attaches its *-environs target to #all-environs.
1258main.Append(BUILDERS = {'CompleteEnvirons' :
1259                        Builder(action=MakeAction(environsComplete, None))})
1260main.CompleteEnvirons('#all-environs', [])
1261
1262def doNothing(**ignored): pass
1263main.Append(BUILDERS = {'Dummy': Builder(action=MakeAction(doNothing, None))})
1264
1265# The final target to which all the original targets ultimately get attached.
1266main.Dummy('#all-targets', '#all-environs')
1267BUILD_TARGETS[:] = ['#all-targets']
1268
1269###################################################
1270#
1271# Define build environments for selected configurations.
1272#
1273###################################################
1274
1275for variant_path in variant_paths:
1276    if not GetOption('silent'):
1277        print "Building in", variant_path
1278
1279    # Make a copy of the build-root environment to use for this config.
1280    env = main.Clone()
1281    env['BUILDDIR'] = variant_path
1282
1283    # variant_dir is the tail component of build path, and is used to
1284    # determine the build parameters (e.g., 'ALPHA_SE')
1285    (build_root, variant_dir) = splitpath(variant_path)
1286
1287    # Set env variables according to the build directory config.
1288    sticky_vars.files = []
1289    # Variables for $BUILD_ROOT/$VARIANT_DIR are stored in
1290    # $BUILD_ROOT/variables/$VARIANT_DIR so you can nuke
1291    # $BUILD_ROOT/$VARIANT_DIR without losing your variables settings.
1292    current_vars_file = joinpath(build_root, 'variables', variant_dir)
1293    if isfile(current_vars_file):
1294        sticky_vars.files.append(current_vars_file)
1295        if not GetOption('silent'):
1296            print "Using saved variables file %s" % current_vars_file
1297    else:
1298        # Build dir-specific variables file doesn't exist.
1299
1300        # Make sure the directory is there so we can create it later
1301        opt_dir = dirname(current_vars_file)
1302        if not isdir(opt_dir):
1303            mkdir(opt_dir)
1304
1305        # Get default build variables from source tree.  Variables are
1306        # normally determined by name of $VARIANT_DIR, but can be
1307        # overridden by '--default=' arg on command line.
1308        default = GetOption('default')
1309        opts_dir = joinpath(main.root.abspath, 'build_opts')
1310        if default:
1311            default_vars_files = [joinpath(build_root, 'variables', default),
1312                                  joinpath(opts_dir, default)]
1313        else:
1314            default_vars_files = [joinpath(opts_dir, variant_dir)]
1315        existing_files = filter(isfile, default_vars_files)
1316        if existing_files:
1317            default_vars_file = existing_files[0]
1318            sticky_vars.files.append(default_vars_file)
1319            print "Variables file %s not found,\n  using defaults in %s" \
1320                  % (current_vars_file, default_vars_file)
1321        else:
1322            print "Error: cannot find variables file %s or " \
1323                  "default file(s) %s" \
1324                  % (current_vars_file, ' or '.join(default_vars_files))
1325            Exit(1)
1326
1327    # Apply current variable settings to env
1328    sticky_vars.Update(env)
1329
1330    help_texts["local_vars"] += \
1331        "Build variables for %s:\n" % variant_dir \
1332                 + sticky_vars.GenerateHelpText(env)
1333
1334    # Process variable settings.
1335
1336    if not have_fenv and env['USE_FENV']:
1337        print "Warning: <fenv.h> not available; " \
1338              "forcing USE_FENV to False in", variant_dir + "."
1339        env['USE_FENV'] = False
1340
1341    if not env['USE_FENV']:
1342        print "Warning: No IEEE FP rounding mode control in", variant_dir + "."
1343        print "         FP results may deviate slightly from other platforms."
1344
1345    if env['EFENCE']:
1346        env.Append(LIBS=['efence'])
1347
1348    if env['USE_KVM']:
1349        if not have_kvm:
1350            print "Warning: Can not enable KVM, host seems to lack KVM support"
1351            env['USE_KVM'] = False
1352        elif not have_posix_timers:
1353            print "Warning: Can not enable KVM, host seems to lack support " \
1354                "for POSIX timers"
1355            env['USE_KVM'] = False
1356        elif not is_isa_kvm_compatible(env['TARGET_ISA']):
1357            print "Info: KVM support disabled due to unsupported host and " \
1358                "target ISA combination"
1359            env['USE_KVM'] = False
1360
1361    # Warn about missing optional functionality
1362    if env['USE_KVM']:
1363        if not main['HAVE_PERF_ATTR_EXCLUDE_HOST']:
1364            print "Warning: perf_event headers lack support for the " \
1365                "exclude_host attribute. KVM instruction counts will " \
1366                "be inaccurate."
1367
1368    # Save sticky variable settings back to current variables file
1369    sticky_vars.Save(current_vars_file, env)
1370
1371    if env['USE_SSE2']:
1372        env.Append(CCFLAGS=['-msse2'])
1373
1374    # The src/SConscript file sets up the build rules in 'env' according
1375    # to the configured variables.  It returns a list of environments,
1376    # one for each variant build (debug, opt, etc.)
1377    SConscript('src/SConscript', variant_dir = variant_path, exports = 'env')
1378
1379def pairwise(iterable):
1380    "s -> (s0,s1), (s1,s2), (s2, s3), ..."
1381    a, b = itertools.tee(iterable)
1382    b.next()
1383    return itertools.izip(a, b)
1384
1385# Create false dependencies so SCons will parse ISAs, establish
1386# dependencies, and setup the build Environments serially. Either
1387# SCons (likely) and/or our SConscripts (possibly) cannot cope with -j
1388# greater than 1. It appears to be standard race condition stuff; it
1389# doesn't always fail, but usually, and the behaviors are different.
1390# Every time I tried to remove this, builds would fail in some
1391# creative new way. So, don't do that. You'll want to, though, because
1392# tests/SConscript takes a long time to make its Environments.
1393for t1, t2 in pairwise(sorted(all_isa_deps.iterkeys())):
1394    main.Depends('#%s-deps'     % t2, '#%s-deps'     % t1)
1395    main.Depends('#%s-environs' % t2, '#%s-environs' % t1)
1396
1397# base help text
1398Help('''
1399Usage: scons [scons options] [build variables] [target(s)]
1400
1401Extra scons options:
1402%(options)s
1403
1404Global build variables:
1405%(global_vars)s
1406
1407%(local_vars)s
1408''' % help_texts)
1409